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Abstract. In this paper we compute the cohomology groups of the second 
Voronoi and the perfect cone compactification A^ OT and A^° r respectively, 
of the moduli space of abclian fourfolds in degree < 9. The main tool is the 
investigation of the strata of A^ OT corresponding to semi-abelic varieties with 
constant torus rank. 



1. Introduction and plan 

The moduli space A g of principally polarized abelian varieties of genus g are 
much studied objects in algebraic geometry. Although much progress has been 
made in understanding the geometry of these spaces, we still know relatively little 
about the cohomology or the Chow groups of A g and its compactifications. These 
are difficult questions even for low genus. Mumford in his seminal paper [Mu2] 
computed the Chow ring of M.2, or what is the same, of the second Voronoi com- 
pactification A^2° r . It was also in this paper that he laid the foundations for the 
study of the Chow ring of M g in general. Lee and Weintraub [LW] have investi- 
gated the cohomology of certain level covers of A^ m '. The cohomology of ^3 and 
of the Satake compactification A3 were determined by Hain [Ha] , while the Chow 
group of the second Voronoi compactification A^ 01 had earlier been computed by 
van der Geer [vdGl]. The authors of this paper proved in [HT] that the Chow ring 
and the cohomology ring of -4j or are isomorphic for g — 2,3. 

Very little is known about the topology of A g and its compactifications in general. 
A positive exception is given by the subring generated by the Chern classes of 
the Hodge bundle in the Chow ring or the cohomology ring of A g . By [vdG2] 
this subring is known explicitly; in particular, it is generated by the odd degree 
Hodge classes A2J+1. Furthermore, by a classical result by Borel [Bo] the Hodge 
classes X21+1 generate the stable cohomology of A g , which is defined in terms of 
the natural maps A g ' A g for g' < g given by multiplication with a fixed abelian 
variety of dimension g — g' . Note that by the construction of A g as a quotient of 
Siegel space, the rational cohomology of A g coincides with the group cohomology 
of the symplectic group Sp(2g,Z). 

In this paper we investigate the case of genus 4 of whose cohomology very little 
is known. There are two reasons why we believe that it is worth the effort to 
undertake this study. One is that the spaces A2 and A3 are very close to the 
moduli spaces M2 and whose cohomology is rather well understood, whereas 
Ai is the first Siegel moduli space where the Torelli map fails to be birational 
and thus one might expect new phenomena. The second reason is that, as our 
discussion of the boundary strata shows, the complexity of the structure of A g and 
its compactifications grows dramatically with g. At the moment calculations on 
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the cohomology of A5, or any of its compactifications, seems far out of reach and 
thus A4 is the only remaining low genus case where the computation of the entire 
cohomology currently seems within reach. 

In this paper we thus investigate the cohomology of toroidal compactifications 
of A4. In general there are several meaningful compactifications of A g . Besides the 
second Voronoi compactification A^° r there is the perfect compactification -4P° rf , 
given by the second Voronoi decomposition and the perfect cone (or first Voronoi) 
decomposition respectively, as well as the Igusa compactification A g gu . It was 
shown by Alexeev [Al] and Olsson [01] that (at least up to normalization) A^° r 
represents a geometric functor given by stable semi-abelic varieties. On the other 
hand .4P crf is, as was proved by Shepherd-Barron [S-B], a canonical model in the 
sense of Mori theory, i.e. its canonical bundle is ample, if g > 12. Finally, Igusa 
constructed *4* gu as a partial blow-up of A^ at and it was shown by Namikawa 
[Nam] that Igusa's model is the toroidal compactification defined by the central 
cone decomposition. In genus g < 3 all of the above toroidal compactifications 
coincide. In genus 4 the Igusa and the perfect cone decomposition coincide and the 
second Voronoi compactification Aj or is a blow-up of ^4 Cr '. However, for general 
g all three compactifications are different. 

The main result of our paper is the determination of the Betti numbers of ^4 Grf 
of degree less than or equal to 9 and of all Betti numbers of Aj OT with the exception 
of the middle Betti number bio. This reduces the problem of the computation of 
the cohomology of Aj or to the computation of the Euler number of A4, which 
is an independent problem in its own right. Indeed, one can compute the Euler 
number of level covers Ai(n) for n > 3 by Hirzcbruch-Mumford proportionality. 
From this one could compute e{Ai) if one had a complete classification of torsion 
elements in the group Sp(8, Z). Although this is not known, it does not seem an 
impossible task to obtain such a classification. This is, however, a hard problem 
which requires different methods from the the ones used in this paper; therefore, 
we will not approach it here. 

Our approach involves computing a spectral sequence converging to the coho- 
mology of A^ or . As a by-product, this spectral sequence determines the long exact 
sequence relating the cohomology with compact support of A\ or with that of A4 
and of its boundary. For this reason, a natural application of our analysis is to ob- 
tain evidence on the existence of non-trivial cohomology classes of A4 in different 
degrees, by giving lower bounds for the Betti numbers of A4. However, all contribu- 
tions from the cohomology of A4 to our computation can be explained using either 
the Hodge classes or a certain non-algebraic class related to the one in H 6 (_4 3 ; <Q>) 
described in [Ha, Thm 1]. This gives rise to the following question: 

Question. Is the rational cohomology of A4 generated by the Hodge classes \i,\s 
and by one non-algebraic cohomology class of Hodge weight 18 arising in degree 12 ? 

The starting point of our investigations is the fact that every toroidal compact- 
ification A g m admits a map ip g : A g m — > A^ &t . We recall that 

Af t = A g uA g -iU...uAi >1 
which allows us to construct a stratification of A g ° r by considering the closed loci 

ft- 9) = ft = p" 1 ^-.) and their open parts ft = ft \ ft+i = ^(Ag-i). Each 
stratum ft is itself the disjoint union of locally closed substrata that are quotients of 
torus bundles over the product of a certain number of copies of the universal family 
Xg-i over A g -i by finite groups. The strategy is then to compute the cohomology 
with compact support of each of these substrata using Leray spectral sequences and 
then to glue these strata by Gysin spectral sequences to compute the cohomology 
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with compact support of /3®. Although this is a natural approach, we are not aware 
that it has been used in this form before apart from [HT] where it was applied to 
the case of genus 3. The reader will however notice that the complexity encountered 
in the present case is of a very different level: we need a full understanding of the 
Voronoi decomposition in genus 4, which in this case can no longer be deduced from 
the knowledge of the basic cone alone. 

The use of Leray spectral sequences requires to know the cohomology with com- 
pact support of Ag-i not only with constant coefficients, but also with coefficients 
in certain symplectic local systems of low weight. In the case of i — 1, 2 we deduce 
this information from results on the cohomology of moduli spaces of pointed curves. 
Passing from the moduli space of curves to the moduli space of abelian varieties 
produces a small ambiguity, which does not influence our final result, mainly be- 
cause it disappears at the level of Euler characteristics. Up to this ambiguity, we 
are able to obtain complete results for the cohomology with compact support of all 
strata contained in the boundary as well as of the closure J \ of the Jacobian locus 
in A^ and we believe that this is of some independent interest. 

In the case of the cohomology of A4 itself, there are two facts which help us. 
The first is that the complement in A4 of the closure of the locus of jacobians has 
a smooth affine variety as coarse moduli space. This implies that its cohomology 
with compact support is trivial if the degree is smaller than 10 and thus that the 
cohomology with compact support of A4 agrees with that of J 4 in degree < 9. 
The second is that Aj OT is (globally) the quotient of a smooth projective scheme 
by a finite group. This implies that its cohomology satisfies Poincare duality, and, 
more specifically, that its cohomology in degree k carries a pure Hodge structure of 
weight k. 

In the case of Aj 01 , putting the cohomological information from all strata f3f 
together yields Table 1, from which we can deduce Theorem 1 by using the Gysin 
spectral sequence associated to the stratification given by the ft. A consequence of 
this spectral sequence is that the cohomology groups with compact support of A4 in 
degree < 9 are sufficient to determine all cohomology groups of A\° r of degree ^ 10. 
In turn, the cohomology groups of Aj or in degree > 11 so obtained can be used to 
gain information on the cohomology with compact support of A4 in degree > 11, 
thus leading (using Poincare duality) to the question formulated above. Finally, we 
obtain the Betti numbers for A^ er in Theorem 2 by using the fact that Aj° r is a 
blow-up of A\ crf in one point. 

The plan of the paper is as follows. In §2 we prove the main results using 
cohomological informations on the strata ft . The geometrical study of each of the 
five strata ft is performed in the following five sections. Finally, in the appendix 
we collect and prove all results on the cohomology of local systems on A2 and *4,3 
used in Section 4 and 5. 
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position. 
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Vai,...,a„ 


rational local system on A g induced by the 
representation indexed by the partition (Ai, . . . , X g ) 


Sp(2 5 ,Q)- 


^Sat 


Satake compactification of A g 






Voronoi compactification of A g 






universal family over A^ or 




^pcrf 


perfect cone compactification of A g 




4 SU 


Igusa compactification of A g 




Mg t n 


moduli stack of non-singular curves of genus g with 
points 


n marked 


Mg := Mgfi 








symmetric group in d letters 




Sym 2 > (R5) 


space of real positive semidefinite quadratic forms in IE 





(ipi, . . . , (p r ) convex cone generated by the half rays R>o<£>i, ■ • • , M.>o(fi r 

For every g, we denote by ip g : A^ or — > -4g at (respectively, tp g : A^ crf — > -4g at ) 
the natural map from the Voronoi (respectively, perfect cone) to the Satake com- 
pactification. Let Tig : X^ m ->■ A Y g m be the universal family, q g : X^ m X^ OT / ± 1 
the quotient map from the universal family to the universal Kummer family and 
kg : Xj 01 1 ± 1 — > A^° r the universal Kummer morphism. 

For < i < g, we set $ = ^{Ag-i) C A Y g m , ft = ^{Af^) C A v g m and 

(Sr^^gHA^cA^. 

We denote the Torelli map in genus g by r g : Ai g — > A g its image, the Jacobian 
locus, by J g = Tg(Mg) and closure of the image in A g by J g . 

Throughout the paper, we work over the field C of complex numbers. All co- 
homology groups we consider will have rational coefficients. Since the rational 
cohomology of a Deligne-Mumford stack coincides with the rational cohomology 
of its coarse moduli space, we will sometimes abuse notation and denote stack and 
coarse moduli space with the same symbol. 

In this paper, we make extensive use of mixed Hodge structures, focussing mainly 
on their weight filtration. We will denote by Q(— k) the Hodge structure of Tate 
of weight 2k. For two mixed Hodge structures A, B we will denote by A © B their 
direct sum and by A + B any extension 

Q^B^E^A^O. 

Furthermore, we will denote Tate twists of mixed Hodge structures by A(— k) — 

A(8)Q(-fc). 

2. Main theorems 

Theorem 1. The cohomology of A^ OT vanishes in odd degree and is algebraic in 
all even degrees, with the only possible exception of degree 10. The Betti numbers 
are given by 



i 


2 4 6 8 10 12 14 16 18 20 


h 


1 3 5 11 17 10 + e(At) 17 11 5 3 1 



where c(Aa) denotes the Euler number of A4. 

The only missing information needed to compute all Betti numbers of A^° r is 
the Euler number. As we shall see, we are able to compute the Euler numbers of all 
strata (3f for i > 1, and thus, as already mentioned, it would suffice to compute the 
Euler number of the space A4 itself (see the introduction for comments on this). 
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Theorem 2. The Betti numbers of A^ cri in degree < 9 are given by 



i 





1 


2 


3 


4 


5 6 


7 


8 9 


h 


1 





2 





3 


8 





14 



Moreover, all cohomology classes of degree < 9 are algebraic. 

Corollary 3. The rational cohomology of Ai vanishes in degree 1,11 and all de- 
grees > 13. Furthermore one has i7°(^ 4 ;Q) = Q(-10), H 2 (Ai]Q) = Q(-9) and 
H 12 (Ai,Q) = Q(— 6) + Q(— 9). For the remaining Betti numbers a lower bound is 
given in the table 
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3 


4 


5 


6 


7 8 
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10 


11 


12 


> 13 




1 





1 


> 


> 1 


> 


> 2 


> > 1 


> 


> 1 





2 






Note that the vanishing of b\ also follows independently from simple connect- 
edness of Ai [HR, Theorem 4.1] and that b 2 — 1 corresponds to the fact that the 
Picard group is generated by the Hodge line bundle (over Q). 



Proof of Theorem 1. To compute the cohomology of Aj° r , we study the Gysin spec- 
tral sequence E™ i/P+«(^ or ;Q) associated with the filtration {Ti} i=K .. fi such 
that 

• Ti /?5_2? ^ 1, • • • 5 4, 

• T 5 =IUT 4 ; 

• T 6 = Aj m . 

The E 1 term of this spectral sequence has the form E\' q = HP+i(T p \ T p _i; Q). 
For p = 1, . . . , 4 the strata T p \ T p _i coincide with the strata of Aj or of semi-abelic 
varieties of torus rank 5 — p: their cohomology with compact support is computed in 
the next sections by combining combinatorial information on the toroidal compact- 
ification with the geometry of fibrations on moduli spaces of abelian varieties (see 
Propositions 7, 8, 24 and Theorem 26). The stratum T5 \ T4 is the closure inside 
Ai of the locus of jacobians. Its cohomology with compact support is computed in 
Lemma 6. 

The only remaining stratum is the open stratum T§ \T^. Let jf at be the closure 
of Ji in A% at . Since this contains the entire boundary of .4f at it follows that 

T 6 \ T 5 = A A \ J 4 = A s 4 at \ Ji at . 

The latter set is affine since it is the complement of an ample hypersurface on 
^4 at (see [HaHu]). In particular, its cohomology with compact support can be 
non-trivial only if the degree lies between 10 and 20. 

From this it follows that the E\ term of the Gysin spectral sequence associated 
with the filtration {Ti} is as given in Table 1. For the sake of simplicity, in that 
table we have denoted ^(-^25^2,2) and (A2; ^2,2) with the same symbol H, 
even though a priori they are only isomorphic after passing to the associated graded 
piece with respect to the weight filtration. (Furthermore, the results in in [T4] imply 
H = 0.) 

Since the terms in the sixth column are only known for q < 3, in the following 
we will only deal with the terms of the spectral sequence that are independent of 
them, that is, the E^' q terms with p + q < 8. 

Let us recall that A^° r is a smooth Deligne-Mumford stack which is globally 
the quotient of a smooth proper variety by a finite group. From this it follows 
that the cohomology groups of A\ m carry pure Hodge structures of weight equal 
to the degree. Therefore, the Hodge structures on E™ have to be pure of weight 
p + q. This means that for all p, q, the graded pieces of E\ ' q of weight different from 
p + q arc killed by differentials. In particular, if we restrict to the range p + q < 9, 
this gives that the Eoo terms are as given in Table 2. Of course, this does not 
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Q(-9) 
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Q(-8) 
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Table 2. in the range p + q < 9. 
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as the e^-diffcrential -E" 2,3 — > E\ ' 2 have rank 1, but this is not the only possibility. 
The claim on the cohomology of Aj° r in degree < 9 follows from the Eoo term in 
Table 2. The claim on the cohomology in degree > 11 follows by Poincare duality. 
Finally, the computation relating the middle Bctti number 610 to the Euler number 
e{Ai) follows from the additivity of the Betti numbers of the stratification {T.}. 

□ 

Remark 4. The fact that the mixed Hodge structures on the E p,q in Table 1 are 
compatible with obtaining E^ 1 terms that carry pure Hodge stuctures of the correct 
weight provide an important check on the correctness of our computations. 

Proof of Theorem 2. The proof is analogous to that of Theorem 1. Rather than 
working with the filtration {Ti}, we will consider the stratification {T[ erl } defined 
analogously by 7; porf = 0g* for 1 < i < 4 and T porf = J A U T 4 porf , T pcrf = Af rf . 
The closed stratum T\ is the the locus /3 pcrf of torus rank 4 inside „4 porf ' . Hence 
E hq = jjq+i({3P cli ; Q) can be obtained from Theorem 25. 

Since the exceptional divisor of the blow-up map q : A^ m — > A^ 011 is contained in 
7\, we have (^4 6rf \q(Ti)) = (Aj 01 \T\). In particular, the Gysin spectral sequence 
associated with the stratification of A^° l1 has E\ ' 9 terms that coincide with those 
of Table 1 for p > 2. Moreover, also the rank of all differentials E™ -> ^+ r '«- r+1 
coincide with those for the filtration {Ti} as long as no £y ,9 -terms are involved. This 
already implies the claim for all degrees different from 6. In degree 6, it is necessary 
to decide whether the class of Hodge weight 2 in E^' 1 is killed by differentials of the 
spectral sequence or not. If we consider the map A4 01 D /?4 —> /3f crf C A^ ri , we 
have that the weight 2 class on /? pcrf lies in the image of the weight 2 class in the 
cohomology of ^4, which was killed by differentials for purity reasons on „4 4 or . This 
implies that this must be the case also on ^4 6rf . From this the claim follows. □ 

Proof of Corollary 3. The lower bounds in the claim are those given by the dimen- 
sion of the subring generated by Ai and A3. The vanishing of the cohomology of 
Aa in all degrees i > 13 and in degree 11, as well as H 12 (A A ; Q) = Q(-6) + Q(-9) 
follow directly from the last two columns of Table 1 by Poincare duality. □ 

Remark 5. Comparing Table 1 with the cohomology of „4 4 or of degree > 11 suggests 
that the cohomology of the open stratum A^XJ^ could vanish in all positive degrees, 
with the exception of degree 10 on which Poincare duality yields no information. 

The reason is the following. One can reinterpret the first 4 columns of Table 1 
as the E\ terms of a Gysin spectral sequence converging to the cohomology of the 
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boundary dAj° r = Aj° r \ A4 . Then the remaining information from that Table is 
equivalent to the study of the long exact sequence 

(2.1) H*(A i; Q) -> H k (Aj m ;Q) -> H k (dAj or ;Q) -> H k+1 (A i; Q) 

associated with the closed inclusion of the boundary in A^°" . One can compare the 
information on the cohomology of the boundary coming from Table 1 with the Bctti 
numbers of Aj 01 in degree > 11 from Theorem 1. Then one sees that even in this 
range the results are compatible with the vanishing of the cohomology of A4 \ J 4, 
or, cquivalently, with the hypothesis that the cohomology of A4 is the minimal 
possible, i.e. generated by Ai, A3 and a 6 H 9 ' 9 (H 12 (A4; Q)) from Corollary 3. 
This would imply that the cohomology of A4 coincides with the stable cohomology 
in degree < 10, while a priori this is known only in degree < g — 2 = 2. 

Furthermore, (2.1) gives strong restrictions on the possible existence of coho- 
mology classes on A4 that are not in the subring generated by the Hodge classes. 
This follows from the purity of the cohomology of A^° r combined with Table 1, 
which ensures that the cohomology of dA^° r is very close to be pure itself. Prac- 
tically, this forces non-trivial cohomology classes from A4 \ J 4 to appear in pairs 
of isomorphic Hodge structures, occurring as graded pieces of H k (A4 \ J 4; Q) and 

H k+1 (A4\ J 4 ;Q). _ 

One could also use Table 1 to prove the vanishing of H k (A4 \ J^Q). Then 
one needs to prove that all (algebraic) classes of weight 10 — k that occur in E\ ' q 
with p + q = 10 — k give rise to cohomology classes in H^°^ k (A^° r ; Q) that are 
linearly independent. This is known for divisors (ensuring the vanishing of H k (A4 \ 
J"4;Q) for k = 1,2). It would be interesting to investigate it for classes of higher 
codimension. 

Note that, if one knew that H k (A4 \ J 4; Q) vanishes for all 1 < k < 9, then this 
would yield the following result for the Betti numbers of A\ crf in degree > 11: 



i 


12 


14 


16 


18 


20 


h 


14 


9 


4 


2 


1 



as well as the vanishing of all odd Betti numbers of A^ cr . 

3. Torus rank 

We start by considering T 5 \ T4, which is the Zariski closure J 4 of the locus of 
jacobians J 4 — r 4 (A^4) inside A4. 

Lemma 6. The only non-zero Betti numbers with compact support of J 4 are as 
follows: 



i 


18 


16 


14 


12 


10 8 


h 


1 


1 


2 


1 


1 2 



In particular, all odd Betti numbers vanish. 

Furthermore, all cohomology groups with compact support are generated by alge- 
braic classes, with the only exception of H®(J4;Q), which is an extension o/Q(— 4) 
by Q(-l). 

Proof. We compute the cohomology with compact support of J 4 by recalling that 
the Zariski closure of the locus of jacobians in A4 is the union of the image of the 
Torelli map and the locus of abelian fourfolds that are products of abelian varieties 
of dimension < 3. This allows to cover J4 by the following locally closed disjoint 
strata: 

S 1 = Sym 4 A, S 2 = r 2 (M 2 ) x Sym 2 A, S 3 = Sym 2 r(M 2 ), 
S 4 = t 3 (M 3 ) x Ai, S 5 = T4OM4). 
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Table 3. E\ term of the Gysin spectral sequence converging to 
the cohomology with compact support of the closure of the locus 
of jacobians in A4 
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Q(-4) 
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Q(-i) 
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4 


5 



Furthermore, the Torelli map in all genera induces an isomorphism in cohomol- 
ogy with rational coefficients between Ai g and its image T g (A4 g ). This allows to 
compute the cohomology with compact support of all strata from previously known 
results on the cohomology of M g with g < 4 ([Mu2],[Lo],[Tl]). These yield that the 
Ei term E\ ' 9 = HP +q (S p ; Q) of the Gysin exact sequence of the filtration associated 
with the stratification Sj is as in Table 3. 

In view of Table 3, to calculate the cohomology with compact support of J4 it 
is sufficient to know the rank of the differential 

d : H?0? ;Q) = Q(-6)® 2 — ► # C 13 (J 4 ;Q) = Q(-6) 

in the Gysin long exact sequence associated with the closed inclusion of the locus 
3 4 = J a \ Ji = S3 U £4 C A4 of reducible abelian fourfolds in the Zariski closure 
in A4 of the locus of jacobians J4 = t^Ma). 

We observe that Hl 2 {J™ A ] <Q>) is generated by two 6-dimensional algebraic cycles 
C\ and C2, where C\ is the fundamental class of S3 and C2 the fundamental class 
of t^Kz) x A\, where H.3 is the hyperelliptic locus. Therefore, the surjectivity of d 
is equivalent to the existence of a relation between C\ and C2 viewed as elements 
of the Chow group of J 4. 

Let us denote by Adf the moduli space of stable genus 4 curves of compact type, 
i.e. such that that their generalized Jacobian is compact. Then the Torelli map 
extends to a proper morphism 

r ct : Mf -^J 4 - 

From the geometric description of the map r ct it follows that the image under r ct 
of the Chow group of dimension 6 cycles supported on the boundary Mf \ M4 
coincides with (Ci, C2). Indeed, let D\ be the closure of the locus of stable curves 
consisting of two genus 2 curves intersecting in a Weierstrass point and let D2 be 
the closure of the locus of stable curves consisting of elliptic curves intersecting 
a hyperelliptic genus 3 curve in a Weierstrass point. Then D\ and D 2 map to 
C\ and C2 respectively. It is known that the dimension 6 classes in A4f fulfill 
a relation, given by the restriction of the relation on M.a of [Y, Prop. 2]. When 
pushed forward via r ct , this relation gives a non-trivial relation between C\ and 
C2. Thus the differential d has to be surjective and the claim follows. □ 



10 



KLAUS HULEK AND ORSOLA TOMMASI 



Table 4. E 2 term of the Leray spectral sequence converging to H'((3®; Q). 
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Q(-5) + Q( 
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2(_ 6 )0(l+e) ( 


3(-6) ffie 


Q(-7) 





Q(-8) 
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Q(-i) 


Q(-4) + Q( 


-1) 
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j(_ 5 )e(i+e) ( 


3(-5)® £ 


Q(-6) 





Q(-7) 
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Q(-3) + 
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Q(-4) 





Q(-5) 





Q(-6) 




5 


6 




7 
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9 


10 


11 
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e = rankF c 9 (^ 3 ;V 1 , li o) G {0,1}. 



4. Torus rank 1 

Next, we deal with the locus /3q of semi-abelic varieties of torus rank 1. 

Proposition 7. The rational cohomology with compact support of is as follows: 
the non-zero Betti numbers are 



i 


6 


7 8 


9 10 


11 12 13 14 


16 


18 




2 


1 3 


1 4 + e 


e 5 + e e 3 


2 


1 



where e = rank_ff^(^3; Vi.i q)- The cohomology groups of even degree 2k are alge- 
braic for k > 7; for k < 6 they are extensions of pure Hodge structures of the form 
H 2k (f3%;Q) = Q(-fc)®(<>2 fc -i) + Q(fc _ 3) 77j e Hodge structures in odd degree are 
given by H 2k+1 (/3°;Q) = Q(2 - k) for k = 7, 9 and H 2k+1 {(i° 2 -Q) = Q(-fc)® e for 
k = 11, 13. 

Proof. To compute the cohomology with compact support of ft® we will use the 
map &3 : (3® — > A3 realizing /3° as the universal Kummer variety over A3 . The fibre 
of (3® over a point parametrizing an abelian surface S is K := S/ ± 1. 

Note that the cohomology of K vanishes in odd degree because of the Kummer 
involution. The cohomology of K is one-dimensional in degree and 6 and induces 
trivial local systems on ^3. The cohomology group H 2 (K; Q) = /\ 2 -ff 1 (S'; Q) is 15- 
dimensional and induces the local system Vi i i i o©Q(— 1) on _4 3 . By Poincare duality 
we have H 4 (K;Q) = H 2 (K;Q) ® Q(-l), inducing the local system Vi i i ;0 (-1) ® 
Q(-2) on A 3 . 

The cohomology with compact support of ^.3 in the local system Vi,i,o is cal- 
culated in Lemma 35. We refer to Theorem 31 for the cohomology with compact 
support of A3 with constant coefficients, which was calculated by Hain in [Ha]. 
These results allow to compute E^' q = i/P(^4 3 ; i??/c 3>t (Q)) for the Leray spectral 
sequence E v , q => HP +q (f3^ y Q) associated with fc 3 : /3? -> ^3. This E 2 term is given 
in Table 4. Note that all differentials of this Leray spectral sequence vanish for 
Hodge-theoretic reasons, so that E 2 = E^. Specifically, all differentials must in- 
volve one E^' q term with p + q odd, but there are only two such terms, namely E^ 2 
and E^' 4 . It follows from Table 4 that for both these terms, any differential dk with 
k > 2 which involves one of them will map either to or to a E 2 term that carries 
a pure Hodge structure of different weight. In both cases the differential has to be 
0. □ 

5. Torus rank 2 

In this section we compute the cohomology with compact support of the stratum 
[3 2 of Aj or of rank 2 degenerations of abelian fourfolds. For this purpose we recall 
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first the known global construction of 0$ as the quotient of a P 1 -bundlc of a fibre 
product of the universal family over A 2 - 

Furthermore, let us recall that the restriction of the Voronoi fan in genus g to 



that the geometric constructions of the fibrations (3 2 — > A 2 and /3§ — > A\ we give 
in this section and in the following one, respectively, are actually independent of 
the choice of g = 4 but extend to analogous descriptions of the fibres of fibrations 
02 Ag-2 and /J§ ->■ Ag-3 that exist for /?£,/3§ C A^ or independently of g. In 
particular, the geometric construction of j3 2 explained in this section coincides with 
the construction used in [HT, §4] to compute the cohomology with compact support 
of the corresponding locus in A^ OT . 

Proposition 8. The rational cohomology with compact support of f3 2 is as follows: 
the non-zero Betti numbers are 

i 4 6 7 8 9 10 11 12 14 16 



where r — rank H% (A2 ; ^2,2)- If we assume r = 0, then all cohomology groups of 
even degree are algebraic, with the exception of H^((3 2 ]Q) = Q(— 4)® 3 + Q(— 2) 
which is an extension of Hodge structures of Tate type. The Hodge structure in odd 
degree 2k + 1 with k = 3, 4, 5 is pure of Tate type of weight 2k — 4. 

Remark 9. It follows from [T4] that r = 0. 

The proof of this Proposition will given in §5.4 after some preliminary steps. 

In the previous section, we calculated the cohomology with compact support of 
Pi using the map /c 3 : P® — > A3 given by the universal Kummcr variety. This map 
extends to the stratum (3 2 of degenerations of abelian fourfolds of torus rank 2, 
giving a map fc 3 : \ /3 3 ) — > A^ or . Under this map, the elements of Aj or with 
torus rank 2 are mapped to elements of Aj m of torus rank 1. If we denote by 
f3' t ° the stratum of ^ or of semi-abelian varieties of torus rank exactly t, we get a 
commutative diagram 



the fibres of 7r 3 over points of (3[ are rank 1 degenerations of abelian threefolds, 
i.e. compactificd C*-bundles over abelian surfaces. A geometric description of 
these compactified C* -bundles is given in [Mul]. They are obtained by taking 
the P 1 -bundle associated to the C*-bundle and then gluing the 0- and the 00- 
scction with a shift, defined by a point of the underlying abelian surface that is 
uniquely determined by the line bundle associated to the C*-bundlc. In particular, 
this shift is for the fibres of the 7r 3 over the 0-section of the Kummer fibration 

f3[° = (X2/ ± 1) A2, which arc thus products of a nodal curve and an abelian 
surface. 

We want to describe the situation in more detail. For this, consider the universal 
Poincare bundle V — > X 2 x^ 2 X 2 , normalized so that the restriction to the zero 
section X 2 — > X 2 x^ 2 X 2 is trivial. Let U — F(P © C^ 2X x 2 ) ^ e ^ e associated 




bi 1 2 1 + r 4 + r 1 + r 5 + r 1 5 3 1 
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P^bundle. Using the principal polarization we can naturally identify X 2 and X 2 , 
which we will do from now on. We denote by A the union of the 0-section and the 
oo-section of this bundle. Set U = U \ A, which is simply the C*-bundle given by 
the universal Poincare bundle V with the 0-section removed and denote the bundle 
map by /: U — > X 2 x_^ 2 X 2 . Then there is a map p: U —> 13 2 with hnite fibres. 
Note that the two components of A are identified under the map p. The restriction 
of p to both U and to A is given by a finite group action, although the group is not 
the same in the two cases (see the discussion below). 

5.1. Geometry of the C*-bundle. We now consider the situation over a fixed 
point [S] G A 2 . For a fixed degree line bundle Co on S the preimage / _1 (S I x 
{£0}) is a semi-abelian threefold, namely the C*-bundle given by the extension 
corresponding to Co G S. This semi-abelian threefold admits a Kummer involution 
1 which acts as 1 H- — x on the base S and by t t-t 1/t on the fibre over the zero 
section. The Kummer involution t is defined universally on U. 
Consider the two involutions ii,i 2 on X 2 x^ 2 X 2 defined by 



for every abelian surface S and every p,q G S. These two involutions lift to involu- 
tions ji and j 2 on U that act trivially on the fibre of /: U — > X 2 x_^ 2 X 2 over the 
zero section. 

The following lemma can also be proved directly from the toroidal construction 
of Aj or using the approach of [S-B, Lemma 2.4]. 

Lemma 10. The diagram 



over p\jj: U — > p(U) = (3 2 \ p(A) is the quotient of U by the subgroup of the 
automorphism group of U generated by and j 2 . 

Proof. Since the map p' in the diagram (5.1) has degree 8 and t,ji,j 2 generate a 
subgroup of order 8 of the automorphism group of U, it suffices to show that the 
map p\u factors through each of the involutions t and ji,j 2 . 

Recall that the elements of (3 2 correspond to rank 2 degenerations of abelian 
fourfolds. More precisely, every point of p{U) corresponds to a degenerate abelian 
fourfold X whose normalization is a P 1 x P 1 -bundle, namely the compactification 
of a product of two C* -bundles on the abelian surface S given by k\ o &2([X]). The 
degenerate abelian threefold itself is given by identifying the 0-sections and the 
oo-sections of the P 1 x P 1 -bundle. This identification is determined by a complex 
parameter, namely the point on a fibre of /: U — > X 2 x^ 2 X 2 . 

Since a degree line bundle Co and its inverse define isomorphic semi-abelian 
threefolds and since the role of the two line bundles is symmetric, the map p\u 
factors through 1 and j 2 . Since j\ is the commutator of 1 and j 2 the map p\u also 
factors through j\ . □ 

We will compute the cohomology with compact support of P 2 by considering the 
Leray spectral sequence associated with the fibration k 2 o k 3 : f3 2 — > A 2 . This re- 
quires to compute the cohomology with compact support of the fibre (fc2ofc 3 ) -1 ([<?]) 



h{S,p,q) = (S, -p, -q) and i 2 (S,p,q) = (S,q,p) 



9 



where p' : 



(5.1) 
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k 

8 
6 
4 
2 













(A 2 A)(-2) 
A® 2 (-1) 
A 2 A 



^-alternating 



Table 5. Cohomology of S x S/{i ll i 2 ) 



over a point [S] E A 2 . To this end, we decompose (k 2 o fc 3 ) 1 ([S}) into an open 
part given by its intersection with p(U) and a closed part given by its complement. 

5.2. Cohomology of the open part of the fibre. The fibration g: U — >• A 2 
obtained by composing the C* -bundle /: U — > X 2 x^ 2 X 2 with the natural map 
X 2 x_a 2 X 2 — > ^4 2 plays an important role in the study of the restriction of k 2 o fc 3 to 
p(C/). Namely, the fibre of (k 2 ° ^3) |p(c/) over [>$1 S coincides with the quotient of 
the fibre of g under the automorphism group generated by ji,j 2 and 1. Therefore, 
the cohomology of the fibre of k 2 ok 3 restricted to p(U) is the part of the cohomology 
of 5~ 1 ([S']) that is invariant under ji, j 2 and l. 

We start by computing the actions of i\, i 2 and of the involution k : (p,q) n> 
(— p, q) induced by the Kummer involution of semi-abelian threefolds of torus rank 
1 on the cohomology of S x S. Recall that the cohomology of S is isomorphic to 
the exterior algebra generated by the 6-dimensional space A := H 1 (S;Q) and that 
H*(S x S;Q) ^ H*(S:Q)® 2 by the Kunneth formula. Using this description, one 
can calculate the part of the cohomology of S x S which is invariant under i\ and i 2 . 
In particular, since all cohomology in odd degree is alternating under the involution 
ii, the only non-trivial invariant cohomology groups are in even degree. We give 
the description of the invariant cohomology groups in the second column of Table 5. 
One then proceeds to investigate their structure with respect to k. For instance one 
can use the isomorphism H k (S x S; Q)^.*) ^ H k (S x S/(i 1 ,i 2 ,K);Q), together 
with the fact that the quotient of S x S by the subgroup generated by i\, i 2 and k is 
the second symmetric product of S/ ± 1. In this way one proves that the behaviour 
of the cohomology with respect to k is as given in the last two columns of Table 5. 

Lemma 11. The (ii,i 2 , ^-invariant part of the Leray spectral sequence associated 
with the C* -bundle i g _1 ([5']) — > S x S gives rise to a spectral sequence El' q =>■ 
H p+q ((k 2 o fc3| (9 ([/)) _1 ([5']); Q) which behaves as follows: 

- E\' q vanishes for q ^ 0, 1; 

- E^' is the part of H k (S x S;Q) which is invariant under i\, i 2 and k; 

- E%' is the part of H k (S x S; Q) which is invariant under i\, i 2 and alter- 
nating under k, tensored with the Tate Hodge structure Q(— 1). 

Furthermore, the Eoc term of this spectral sequence, together with its structure as 
Sp(4, Q) -representation, is as given in Table 7. 

Proof. Let us consider the C*-bundlc f s := f\ g -i([s]) ■ d^ 1 ^}) -> SxS. The Leray 
spectral sequence in cohomology associated with fg converges to the cohomology of 
and has E 2 term E v 2 q = HP(S x S; Q) ® H q (C*;Q). However, we are only 
interested in the part of the cohomology of ,9 _1 ([5']) which is invariant under ji,j 2 
and l. Since the actions of ji, j 2 and u respect the map 5 _1 ([S']) — > S x S, they act 
also on the terms of the Leray spectral sequence associated with fg. In particular, 
the spectral sequence whose E r terms are the (ji , j 2 , i)-invariant part of the terms of 
the Leray spectral sequence associated with fg converges to H k (g~ 1 ([S]); Q)" ,lj2,t . 
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q 
l 




o o A 2 A(-i) o 
Q o (A 2 A) o ( 


A® 2 (-2) 
K-2)©Sym 2 (A 2 A) 


(A 2 A)(-3) 
(A 2 A)(-2) Q(-4) 




1 2 3 
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5 6 7 8 p 



Table 6. E 2 term of the spectral sequence converging to H k (g 1 ([5]); Q)^ 1 ' 82 '^ 
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Table 7. E^ term of the spectral sequence converging to H k (g 1 ([5]); Q)^ 1 '* 2 '^ 



In particular, the E 2 term of this spectral sequence is given by the (ji, J2, t)- 
invariant part of HP(S xS;Q)® Hi{C*:Q). We have already determined the 
behaviour of the projection of these involutions to S x S in Table 5, so it remains 
only to determine their action on the fibre C*. Since ji and ji both fix the fibre of 
/ over the origin, they act trivially on the cohomology of C* . Instead, the Kummer 
involution i acts as the identity on H°(C*; Q) and as the alternating representation 
on iJ 1 (C*;Q). From this the first part of the claim follows. For the convenience of 
the reader, we have written the E 2 term of the spectral sequence in Table 6. Notice 
that this spectral sequence has only two non-trivial rows. Therefore, it could be 
written equivalently as a long exact sequence. In particular, the only differentials 
one needs to study are the ^-differentials. 

These differentials are given by restriction of the differentials of the Leray spec- 
tral sequence associated with the C*-bundle fs- Recall that fs is the C*-bundle 
obtaining by subtracting the 0-section from the Poincare bundle over S x S. There- 
fore (see e.g. [Hu, XVI. 7. 5]) the ^-differentials are given by taking the intersection 
product with the first Chern class of the Poincare bundle, which is known to be 
equal to [diag(5)] — [S x {0}] — [{0} x S], where [•] denotes the fundamental class 
and diag : S — > S x S is the diagonal map. An explicit computation of the inter- 
sections of this class with the K-alternating classes in H k (S x 5;(Q)) 41 ' 42 yields the 
description of E 3 = E^ given in Table 7. Here we have used the fact that Sym A 
is the irreducible Sp(4, Q) -representation ¥2,0, whereas A 2 A decomposes into ir- 
reducible Sp(4, (Q)-representations as Q(— 1) ©Vi,! and Sym 2 (A 2 A) decomposes as 
Q(-2)® 2 © Vi,i(-1) © V 2 ,2- In the notation, Tate twists are only relevant for the 
Hodge structure. 

□ 

5.3. Geometry of p(A). The map p identifies the two components of A, each of 
which is isomorphic to X 2 x_^ 2 X 2 . In particular, the space /f(A) can be realized 
as a finite quotient of X 2 x^ 2 X 2 . This can be read off from the construction of 
the toroidal compactification, as in [S-B, Lemma 2.4]. See also [HS1, Section I] for 
an outline of this construction. Also note that the stratum A corresponds to the 
stratum in the partial compactification in the direction of the 2-dimensional cusp 
associated with a maximal-dimensional cone in the second Voronoi decomposition 
for ,g = 4. A detailed description can be found in [HKW, Part I, Chapter 3]. 
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Specifically, the stratum p(A) corresponds to the GL(2, Z)-orbit of the cone 
{x\, x 2 , {x\ — X2) 2 ). Hence, the map X 2 x_^ 2 X 2 — > p(A) is the quotient map 
with respect to the stabilizer G of the cone {x 2 ,x 2 , (x\ — x 2 ) 2 ) in Sym 2 (Z 2 ). This 
is generated by three involutions: the multiplication map by — 1, the involution 
interchanging x\ and x 2 and the involution x\ i-> x\, x 2 i-> x\ — x 2 . 

These generators of G act on X 2 x_4 2 X 2 by the following three involutions: the 
involution i\ which acts by (x, y) i-> (—a;, —y) on each fibre S x S, the involution Z2 
which interchanges the two factors of X 2 x^ 2 X 2 and finally the involution i 3 which 
acts by (x, y) i— >■ [x + y, — ?/)■ 

From this description, it follows that there is a fibration g' : p(A) — > _4 2 whose 
fibre over [S] £ A 2 is isomorphic to the quotient of S x 5 by the subgroup of 
Aut(5 f x S) generated by the three involutions i\, i 2 and i% introduced above. 

If we write A := H 1 (S x {0}; Q) and A' := ^({0} x S; Q), then the cohomology 
of S x 5" is the exterior algebra of H 1 ^ x S;Q) = A © A'. If we denote by 
fi, . . . , /4, resp. / 5 , . . . , / 8 the generators of A, rcsp. A', the three involutions act 
of H^S x S;Q) as follows: 

(5.2) fi^-fu i = l,...,8, 

(5.3) /i «-/i +4) i = l,...,4, 

(5-4) /i ^ /i, / i+4 i ^ /i - / i+4) i = 1, . . . , 4. 

Then one proceeds to determine the invariant part of the exterior algebra of 
A © A' under these involution. Moreover, to determine the local systems Rfg' t (Q) 
that appear in the Leray spectral sequence associated with g' : p(A) — > A 2 , one 
needs to investigate the structure of the invariant subspaces as representations of 
Sp(4, Q). An explicit calculation of the invariant classes yields the results which we 
summarize in the following lemma. 

Lemma 12. The rational cohomology groups the fibre of g' ' : p(A) — > A 2 over 
a point [S] e A 2 , with their mixed Hodge structures and structure as Sp(4,Q)- 
representations, are given by 



H k ( 9 '-\[s]y,( 



Q k = 0, 

A 2 Vi, = Q(-i)®v M k = 2, 

Q(-2)® 2 ffiV 1 , 1 (-l)ffiV 2 ,2 fc = 4, 

(A 2 Vi.o)(-2) =Q(-3)eV M (-2) fc = 6, 

Q(-4) fc = 8, 

otherwise. 



5.4. Proof of Proposition 8. We will prove Proposition 8 by investigating the 
Leray spectral sequence associated with the fibration k 2 o fc 3 : (3 2 — > A 2 . As ex- 
plained at the beginning of this section, the fibre of k 2 o fc 3 over a point [S] £ A 2 is 
the disjoint union of an open part, which is (k 2 o fc3 |p(j/) ) 1 ([5'] ) > an d a closed part, 
which is the fibre of g' : p(A) — > A 2 . The cohomology of the fibre of k 2 o ks \ p (u) was 
determined in Lemma 11, whereas the cohomology of the fibre of g' was computed 
in Lemma 12. Notice that (k 2 o fcsUm) -1 ^/?]) = g~ 1 ([S])/ (ji , j 2 , t) is the finite 
quotient of a smooth quasi-projective variety, so that we can use Poincare duality 
to obtain its cohomology with compact support from its cohomology. Furthermore, 
since g'~ 1 ([S']) = S 2 /{i\, i 2 , is) is compact, its cohomology with compact support 
coincides with its cohomology. 

To compute the cohomology with compact support of the fibre of k 2 o fc 3 one 
can use the Gysin long exact sequence associated with the inclusion g' _1 ([S']) ^ 
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Q(-i) 2 





Q(-3) 
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Q(-2) 





Q(-3) 
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6 p 



Table 8. E 2 term of the Leray spectral sequence converging 
to the cohomology with compact support of /3%. We denote H = 
H?(A 2 ;Y 2 , 2 ) = H?(A 2 ;Y 2 , 2 ) (up to grading). 



(k 2 ok 3 )- 1 ([S}): 

(5.5) ... -> H^g-'d^qf 1 ^ -> ^((feofc^aSDjQ) -> 

tf c fe (S x S;Q) (<1,<2,<3) ^> F c fe + 1 ( ff - 1 ([S]);Q) (jl ' j2 '° -+ ••■ 

Notice that all differentials 5k in (5.5) have to respect the structure of the co- 
homology groups as representations of Sp(4, Q). In this specific case, this implies 
that all 8k with k ^ 2 vanish, whereas 

S 2 : Q(-l)8Vi,i — )• Vi,i 

is surjective by Lemma 13 below. 

The above determines the cohomology with compact support of the fibre of 
k 2 o k 3 . In particular, it also determines the local systems Rf(k 2 o £3)* (Q) occurring 
in the Leray spectral sequence in cohomology with compact support associated with 
the fibration k 2 o fc 3 . These local systems are given in the first column of Table 8. 

Recall that the E 2 term of the Leray spectral sequence HP +q ((3 2 ;Q) 
associated with k 2 o ^3 are of the form E™ = HP(A 2 ; Rf(k 2 o fc3)*(Q)). From the 
decomposition into symplectic local systems of the Rf(k 2 o £3)* (Q), one gets the E 2 
term of the Leray spectral sequence as in Table 8. Here we used the description of 
the cohomology with compact support of A 2 with coefficients in the local systems 
Vi,i, ¥2,0 an d V 2 ,2 from Lemma 34 and 36. 

To prove the claim, it remains to show that the Leray spectral sequence de- 
generates at E 2 . From the shape of the spectral sequence, it follows that all d 2 
differentials, and all differentials d r with r > 4 are necessarily trivial. The only dif- 
ferentials one needs to investigate are the <i3-differentials E^ — s> Eq q _ 2 . These are 
necessarily by Hodge-theoretic reasons, because morphisms of Hodge structures 
between pure Hodge structures of different weights are necessarily trivial. From 
this the claim follows. □ 

Lemma 13. The differential 8 2 : H 2 C (S x S;Q) {il ' i2 ' i3) -> fl'|(ff- 1 ([S]);Q)°' 1,J ' a ' 
is surjective. 
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Proof. Wc shall prove the claim by an explicit computation on the generators of the 
groups involved. Since in the proofs of Lemma 11 and Lemma 12 we described the 
cohomology of the fibres of E rather than those of the cohomology with compact 
support, to compute the rank of 82 we shall compute the rank of the map induced 
by 82 on cohomology by Poincare duality 

8* 2 : H\S x S;®f ui2 ' i3) ® Q(-l) -> H 7 (g-\[S}); Q f^\ 
which can be described explicitly as the composition of the map 

H^SxS^f 1 ^ — > H?(g-\[S}y,Q) 
a 1 — > Q ® a, 

where Q denotes the image of the generator of H 1 (C* ; Q) inside the cohomology of 
<7 _1 ([5']), and the symmetrization with respect to the group G generated by j\,j2 
and l. 

A direct computation yields that the classes 

Vi,j,k,l = fi A fj A f i+4 A f j+4 A (2/ fc A f t + 2f k+4 A fi +4 + fk A fi+4 + fk+i A fi) 

with {i,j,k,l} = {1,2,3,4} form a basis of H 6 (S x S; Q) (il ' i2 ' is) . Here /i,...,/ 8 
denote the basis of /1, . . . , f$ described in Section 5.3. Then we have 

8*2 (vi,j,k,l) = Q ® /i A fj A / i+4 A / J+ 4 A (/ fe A /; +4 + fk+i A //) 
and these classes generate H 1 '((/ _1 ([<?]); Q). From this the claim follows. □ 

6. Torus rank 3 

In this section we compute the cohomology with compact support of the stratum 
with torus rank 3. As in the previous section, our strategy is based on a detailed 
geometric analysis of the fibration /3® — > Ai whose toric part is actually independent 
of the choice of g = 4. 

6.1. Description of the geometry. We first note that the spaces A l ^ n and Aj m 
only differ over A and hence /3|' orf \ j3f rf = ^ m \ 01™ =: /3§. In this section wc 
want to compute H'((3q; Q). For this we first give a geometric description. 

In order to compactify A4 we start with the lattice Z 4 . The choice of a toroidal 
compactification corresponds to the choice of an admissible fan £4 in the cone of 
semi-positive forms in Sym 2 (Z 4 ). One possible choice for such a fan is given by 
the perfect cone decomposition £4^. A cusp of A4 corresponds to the choice 
of an isotropic subspace U <Z Q 4 . In our case, for the stratum over A\ we take 
U = (ei,e2,es) where the e, (1 < i < 4) are the standard basis of Z 4 . This 
defines an embedding Sym 2 (Z 3 ) C Sym 2 (Z 4 ) and, by restriction of £4™ , also 
a fan in Sym 2 (Z 3 ) which is nothing but Sg 01 ^. The stratum itself consists 
of different strata which are in 1 : 1-correspondence with the GL(3, Z)-orbits of 
the cones a in Sg Crf whose interior contains rank 3 matrices. Up to the action 
of GL(3,Z) there is a unique minimal cone with this property, namely the cone 
= (xl,X2,x^). Beyond that there are (again up to group action) 4 further 
cones. In dimension 4 there are two cones, namely af ^ — (x\,x\,x\, (X2 — x^) 2 ) 
and afj = (x 2 , x 2 ,, (x2 — X3) 2 , (x\ — x^) 2 ). In dimensions 5 and 6 there are one cone 
each, namely = {x\, x 2 , x§, (x 2 — X3) 2 , {x\ — x 3 ) 2 ) and = {x\, x\, x 2 , (x 2 — 
x 3 ) 2 , (xi — x 3 ) 2 , (xi — x 2 ) 2 )- Note that all cones are contained in . In fact the 
perfect cone decomposition in genus 3 (where it coincides with the second Voronoi 
decomposition) is obtained by taking the GL(3, Z)-orbit of and all its faces. 

To describe the various strata let X\ — > A\ be the universal elliptic curve and 
let X\ x_4j X\ x_4j X\ — > A\ be the triple product with itself over A\. Let T = 
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n,2 


r l,3 


Tl.A 


n,2 


T2,2 


1~2,3 


T~2A 


T l,3 


^2,3 


T~3,3 


T3.4 


\Tl,4 


7"2,4 


1~3,4, 


T4,4/ 



Sym 2 (Z 3 ) <g) C* be the 6-dimensional torus associated with Sym 2 (Z 3 ). Every cone 
cr in Sg erf is basic (i.e. the generators of the rays are part of a Z-basis of Sym 2 (Z 3 )) 
and defines a subtorus T a C T of rank dim (cr). We can now give a description of 

PI 

Proposition 14. The variety ft® admits a stratification into strata as follows: 

(i) there are 6 strata of ft®, corresponding to the cones cr^ 3 ', ofj, 
and cr( 6 ). 

(ii) Each stratum is the finite quotient of a torus bundle over X\ X\ x^ 
Xi Ai with fibre T/T a . 

Proof. See [S-B, Lemma 2.4]. □ 

We shall now compute the cohomology with compact support for each of these 
strata and then use a spectral sequence argument to compute the cohomology with 
compact support of /3g. We denote the substratum of j3® associated with a cone cr 
by /^(cr) and the total space of the torus bundle by T(cr). 

Before we state the results we have to give a brief outline of the construction 
of the stratum /3§ (cr) with a view towards describing suitable coordinates in which 
our calculations can be done. Consider a point in Siegel space of genus 4: 



T = 



Going to the cusp over A\ means sending the top left hand 3x3 block of this 
matrix to ioo. Wc shall make this more precise. We consider the basis of Sym 2 (Z 3 ) 
given by U*j = (2 — 5ij)xiXj. Let tij (1 <i,j< 3) be the dual basis. Setting 

U,j = e 2 "^ 1 ^ (1 < i, j < 3) 

defines a map 

(6.1) H 4 -> T x C 3 x Hi 

T !-> ((t»,j),Ti,4,T2,4,7 - 3,4,7'4 ) 4). 

This corresponds to taking the partial quotient X(U) = P'(U)\M4 with respect to 
the center P'(U) of the unipotent radical of the parabolic subgroup P(U) associated 
with the cusp U. We denote P"{U) = P(U)/P'(U). The partial quotient X(U) 
can be considered as an open set of the trivial torus bundle X(U) (with fibre T) 
over C 3 x Hi. Using the fan £3°"^ one constructs Alport ([/) by taking a fibrewise 
toric embedding. Let X sP erf (U) be the interior of the closure of X(U) in Alport (U). 
The action of the group P"(U) on X(U) extends to an action on X E pert (U) and one 
obtains the partial compactification in the direction of the cusp U by Y^pcrf (U) = 
P"{U)\X^ rt {U). 

Every cone a G Eg erf defines an affinc toric variety X a . Since all cones a are 
basic one has X a = C k x (C*) 6 ~ fe where k is the number of generators of cr. Every 
inclusion a C cr' induces an inclusion X a C X a > . Note that X( ) = T and, in 
particular we obtain an inclusion Xiq\ = T C X a ( 6 ) = C 6 . Let T\, . . . ,T 6 be the 
coordinates on X a (6) = C 6 corresponding to the generators of which form 
a basis of Sym 2 (Z 3 ). Computing the dual basis of this basis one finds that this 
inclusion is given by 

la x T\ — il,lil,3*l,2 5 T 2 — t2, 2*2, 3*1, 2, ?3 = *3, 3*1,3*2,3; 

(0.2) rp _ .-1 rp _ .-1 T _ .-1 

J 4 — ^2,3) J 5 — '-1,37 J 6 — <-i,2- 
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The relation to the strata fi^{cr) is then the following. The coordinate T4,4 
defines a point in A\ and the coordinates Ti,4, T2,4, T3,4 define a point in the fibre 
of X\ x_4 x X\ x_4 x Ai -4- ^li over [T4.4] G _4i which is E Tii x EV 4 4 x E Ti4 , where 
E T4 4 = C/(Z + Zt4, 4 ) is the elliptic curve defined by T4, 4 . The fibres of /^(ct) — > 
Ai x_4 x Ai x_4 x Afi are isomorphic to the torus T/T a . 

Finally, we have to make some comments on the structure of the parabolic sub- 
group P(U). This group is generated by four types of matrices. The first type are 
block matrices of the form 



9i = 



/l 






s 



1 








V 



where S" = G Sym 2 (Z 3 ). 



These matrices generate the center P'(U) of the unipotent radical and act by 



n,2 n,3 r i,4\ /ti,i + si,i n,2 

72,2 72,3 72,4 _^ 7i,2 + Sl,2 72,2 
7"2,3 73,3 T 3 ,4 n,3 + Sl,3 72,3 

7"2,4 73,4 74,4/ \ Tl,4 

giving rise to the partial quotient H4 — > T x C 3 x 
The second set of generators is of the form 



/ T i,i 

Tl,2 
r l,3 
\Tl,4 



Si, 2 
S2,2 
S 2 ,3 



7l,3 + «1, 3 
7"2,3 + S2,3 
7"3,3 + S3, 3 
73,4 



72,4 

Hi described above. 



t 1a\ 
7"2,4 
73,4 
T4,4/ 



52 












, where 



G SL(2,Z), 



resp. 





f 1 


M 












f 


tJV 





.93 = 








1 












-*M 


V 



where M,N £ 



Note that the elements of type <?2 7 93 generate a Jacobi group, which, in particular, 
acts on the base C 3 x Hi of the partial quotient by P'(U) given by the map H 4 — > 
C 3 x Hi giving rise to the triple product X\ x^j X\ x_4j A^. 
Finally we have matrices of the form 



94 = 



V 











1 









Q 







V 



where Q G GL(3,Z). 



These matrices are of particular importance to us as they operate on the space 
Sym 2 (Z 3 )by 

GL(3, Z) 9 g : Af i-> t Q~ 1 MQ~ 1 . 
6.2. The cohomology of /^(cr*- 3 '). In this section we will prove 

Lemma 15. The rational cohomology groups with compact support of P^(a^) are 
given by 

( Q(-k/2) fc = 12,14 
ff c fc (/3 3 V 3) );Q) = { Q((5-A)/2) fc = 9,7 

[ otherwise. 

We start by giving an explicit description of the torus bundle T(er^) defined by 
the cone . 
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Lemma 16. Let q a ( 3 ) : T(cr^) — > X\ XAi X\ x .Ai X\ be the rank 3 torus bundle 
associated with a^ 3 \ Then over each fibre E x E x E of Xi X\ xj^ x X\ we have 

T(o-W)\exExe^P* 2 , 3 (V°) ®p1 3 (T ) ®p* h2 (V°) 

where V° is the Poincare bundle over the product ExE with the 0-section removed, 
and Pij : E x E x E — >• E x E is the projection to the ith and jth factor. 

Proof. We first recall the following description of the Poincare bundle over ExE 
where E = C/(Z + Zr). Consider the action of the group Z 4 on the trivial rank-1 
bundle on C x C given by 

(6.3) (m, n 2 , mi, m 2 ): (z 1 ,z 2 , w) h-> 

(Z! + m + m lT , z 2 +n 2 + m 2 r, w -2"«(»«i^™^i+».i™ 2 r)) 

(where the Zi are the coordinates on the base and w is the fibre coordinate). We 
claim that the quotient line bundle on E x E is the Poincare bundle. For this it 
is enough to see that this line bundle is trivial on E x {0} and {0} x E (which is 
obvious) and that it is isomorphic to Oe{0 — P) on E x {P}. The latter can be 
checked by comparing the transformation behaviour of (6.3) to the transformation 
behaviour of the theta function i9(z,r) in one variable (see e.g. [La, 15.1.3.]). 

We have to compare this to our situation. In this case we have an action of the 
group generated by the matrices g% with M,N e Z 3 . For N = {n\,n 2 ,n 3 ) we have 
t»,4 T iA + n i an d for M — (mi, m 2 , m 3 ) we have Tjj i-> nj + rrijTi^ + rriiTj^ + 
mimjTi^ for 1 < i,j ' < 3 and 7^4 n> 7^4 + m^T^. Recall that the entries 7^4 for 
i = 1,2,3 are coordinates on the factors of E x E x E and that it follows from 
(6.2) that we can choose trj with t h] = e 27 " T ^ for = (1, 2), (1, 3), (2, 3) as 

coordinates on the torus T(cr^). Comparing this to the transformation (6.3) gives 
the claim. □ 

Proof of Lemma 15. Recall that the stratum (3^(a^ ) is a finite quotient of the 
rank 3 torus bundle q a ( 3 ) : T(o-^) — > X\ Xj^ x X\ xj^ x X\. This enables us to 
calculate its rational cohomology by exploiting Leray spectral sequences. 

Notice that the base of q a (3) is the total space of the fibration p: X\ x^ X\ Xj± x 
X x -> Ai. Over a point [E] e Ai, the fibre of p is p _1 ([£]) = E x E x E and the 
fibre of po (^(3) over [E] is the total space of the rank 3 torus bundle q a (3) \exExe '■ 
Ex ExE — >• E x E x E described in Lemma 16. The cohomology of (p o 
q a (s))~ 1 ([E]) can be computed by the Leray spectral sequence associated with this 
rank 3 torus bundle: 

(6.4) E™(q a(3) ) = Hi(T/T^;Q)^HP(E x E x E; Q) 

Note that the cohomology of E x E x E (respectively, the torus T/T (a(3> ^) is an ex- 
terior algebra generated by H^Ex Ex E; Q) (resp. H 1 (T/T ( - cr<3 ^;Q)). We denote 
by Qi, Q 2 and Q 3 , respectively, the generators of H 1 (T/T rT<3) ; Q) = ^((C*) 3 ; Q) ^ 
Q 3 defined by integrating along the loop around defined, respectively, by \t^ 3 | = 1, 

i*rji - 1 ot Kl\ = i- 

We can write each copy of E as a quotient E — C/(Ze 2 j_i + Ze 2 ^); i = 1,2,3. 
Then ei,...,ee give rise to a basis of the first homology group oiExExE. We will 
denote by /i , . . . , fe the elements of the basis of H 1 (E x E x E; Q) dual to e\ , . . . , e§. 
Notice that the transformation behaviour of the / 2 j_i and of the / 2 j for 1 < i < 3 
agrees with the transformation behaviour of the coordinates {7^4 1 < i < 3} of 
C 3 = (Zei + Ze 2 + • • • + Ze 6 ) <X>z C (and that of the differentials dn^ which give 
rise to classes in cohomology). 
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As we are interested in the quotient of T(cr^) by the finite group G(a^), 
we shall compute the invariant cohomology with respect to this group. This is 
done in Lemma 17 for the invariant cohomology of the fibre T(*j^)\exExe = (p° 
<7<t(3) using a Leray spectral sequence argument. It remains to determine the 

local systems R\ (po q a ( 3 ) )*(Q) over Ai defined by the fibration p o q^ 3 ) : /3§(cr' 3 ') = 
T(cr( 3 * ) ) — > A\. This is quite straightforward, since the cohomology with compact 
support of the fibre is constant in degrees 12 and 10, and since Sym 2 H X {E; Q) 
induces the symplectic local system Y 2 on A\ . 

Recall that the cohomology with compact support of A\ with constant coeffi- 
cients is concentrated in degree 2, and that the only non-trivial cohomology group 
of Ai with coefficients in V 2 is H^(Ai,Y 2 ) = Q (see e.g. [Gl, Thm. 5.3]). In par- 
ticular, it then follows from Lemma 17 that the Leray spectral sequence associated 
with p o q a ( 3 ) has only two columns containing non-trivial E 2 terms, so it has to 
degenerate at E 2 . From this the claim follows. □ 



Lemma 17. For every [E] G Ai, the rational cohomology with compact support of 
the fibre of (3®(<jW) — > Ai, with its Hodge structures, coincides with the G(a^)- 
invariant part of the cohomology with compact support of the rank 3 torus bundle 
T(o-^)\exExE and is given by 



(H k c {T{o- 



(3)m .--^ <3) ) 
u ExExE, 



Q(-6) fc = 12, 

Q(-5) fc = 10, 

Sym 2 (ff 1 (£;;Q))®Q(-2) k = 8, 

Sym 2 (H 1 (E;Q))®Q(-l) fc = 6, 

otherwise. 



Proof. The stabilizer G(a^) of in GL(3, Z) is an extension of the symmetric 
group 63 (permuting the coordinates x\, x 2 , £3) by (Z/2Z) 3 (acting by involutions 
(x 1 ,x 2 ,x 3 ,x 4 ) i-> (±Xi,±X 2 ,±X 3 ,X 4 )). 

The interchange of two coordinates (say, Xi and Xj) acts on H 1 (E x E x E; Q) 
by interchanging f 2 i-i with f 2 j-i, fu with f 2 j and leaving all other generators 
invariant. The action on _ff 1 (T/T( cr< ^;Q) interchanges Qi and Qj and leaves the 
third generator invariant. 

The automorphism mapping a;, to — Xj acts on H 1 (_E x E x £J; Q) as multiplication 
by —1 on the generators fu-\,fii and on _ff 1 (T/T( <T<3) ^ ; Q) as multiplication by —1 
on Qfc with fc 7^ i. All other generators are invariant. 

We can compute the G(cr( 3 ))-invariant part of the rational cohomology of the 
rank 3 torus bundle T(cr' 3 ')|£;x£;x£; by restricting to the G(er( 3 ))-invariant part 
of the Leray spectral sequence (6.4) associated with q a o). This yields a spectral 
sequence E\ ,q converging to the G(o~^ )-invariant part of H p+ci {T{o'^ > )\exExe] Q)- 

A computation of the part of the tensor product /\* H 1 (E x E x E; Q) ® 
f\' H 1 (T/T ( -' T<3 ^;Q) which is invariant under G(cr^) yields that Ei p 2 ' q is non-zero 
only for (p, q) G {(2, 0), (2, 1), (4, 0), ((2, 2), (4, 1), (6, 0)}. A precise description of 
the generators of the non-trivial E 2 terms is given in Table 9. Note that the spaces 
for p = q — 2 and p = 4, q = 2 are both isomorphic to Sym 2 H 1 (E\ Q) as Sp(2, <Q>)- 
representations. 

Next, one investigates the differentials of the spectral sequence. As differentials 
have to occur between £f ' q terms such that the two p + q have different parity, an 
inspection of the spectral sequence quickly reveals that all differentials have to be 
trivial, with the possible exception of 

(6.5) 4 1 : E^^E 4 / 
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p q dim. generators 

11 

2 1 

2 11 E Qfe®(/2i-iA/ 2j --/2iA/ 2j --i) 

i<j,kjti,j 

2 2 3 E Q j AQ j ®W r f ) ) m = l,2 1 3 
4 1 E^/ii-i A / 2i A / 2j _! A f 2j 

4 11 E Qfe<8>(/2i-iA/ 2j -/ 2i A/ 2j _i)A/ 2/s _iA/ 2fc 

i<j,kjti,j 

4 2 3 E QiKQj®Wj? n) Afu-iAfu, m= 1,2,3 

6 1 /i A/2A/3A/4A/5A/6. 

All indices fc are between 1 and 3. For indices i < j we set W^ 1 ' = 
/w-i A / 2j + / ai A / 2i _i , W fc (a ' = /w-i A /jy_i and wf > = / M A / 2j for fc ^ i, j. 



Table 9. Description of the generators of the E2 terms of the 
G(cr( 3 ))-invariant part of the spectral sequence associated with 

9cr(3) ■ 



and 

(6.6) 4 1 : E^^El- . 

We can determine their rank by exploiting the description of the restriction 
to £ x £ x £ of the torus bundle T(cr^) given in Lemma 16 as a direct sum 
of pull-backs of the Poincare bundle with the 0-section removed. This description 
implies that one can employ the usual description of d 2 differentials of C*-bundlcs to 
investigate e^' 1 and d^' 1 ■ In particular, each of these differentials is given by formally 
replacing each generator Qk of H 1 {T/T a ' ; Q) by the first Chern class of the bundle 
p*j(V), where 1 < i < j < 3 are chosen such that {i,j, k} = {1,2,3}. Recall that 
on the product E x E the Poincare bundle V = E xe(E x {0} + {0} x E — A), 
where A is the diagonal. From this one concludes that Ci(V) =/i A/2 + /3A f± — 
(fi + h) A (/ 2 + fi) = fi A fz — fi A f\. It is then a straightforward calculation to 
prove that both differentials are isomorphisms. 

It remains to pass from cohomology to cohomology with compact support, which 
we can do by Poincare duality, using the fact that 7~(<j^)\exExe is smooth of 
complex dimension 6. Finally, we can identify the G(CT( 3 ))-invariant part of the 
cohomology with compact support of T(ct^)\exExe with the cohomology with 
compact support of its finite quotient (T(o-^)\exExe) /G(a^), which coincides 
with the fibre of /3§(<t (3) ) -> Ai over [E]. □ 

6.3. The cohomology of f3®{a^). In this section we will prove 

Lemma 18. The rational cohomology groups with compact support of /3®(a\ 4 ^) are 
given by 

Q(-6) k = 12 

Q(-5)® 2 A; = 10 

Q(-4) + Q(-2) fc = 8 



k = 5 
otherwise. 
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Proof. We shall make again use of the twofold fibre structure of this stratum. The 
stratum P®{o~^) is a finite quotient of a rank 2 torus bundle 



T(.f) - 



X\ x^ t X\ x_4j X\ with fibres isomorphic to T/T (a i \ Note that the generators of 
crj 4 ' correspond to the first four generators of the cone . Comparing this to the 
embedding described in (6.2) we find that we can choose t^ 3 , t^ 2 as coordinates on 

T/T {a i ). As before we denote p: Ai Ai Ai — > ,4i. 

As we are interested in the quotient of T{o-^) by the finite group G{a^), we 
shall compute the invariant cohomology with respect to this group. Thus we first 
have to describe the automorphism group G{a^) of the cone o~^\ i.e. all elements 
of the form g 3 G GL(3,Z) which fix this cone. We have already discussed this in 
[HT, Section 3]. The result is that the automorphism group is generated by the 
following four transformations: 



(6.7) 
(6.8) 
(6.9) 
(6.10) 



x\ h-> xi, x 2 i-> x 2 - x 3 , x 3 i-> -xs 



II 4 -ii, x 2 ,x 3 H> x 2 ,x 3 



Xl I ^ Xl, X 2 <H> x 3 . 



1,2,3. 



Note that these automorphisms act trivially on the base of the fibration X\ xj^ x 
X\ x_4j X\ — > A.1- 

Again we shall determine the invariant cohomology of the fibre (q w op) _1 ([£]) 

a i 

using the Leray spectral sequence with terms E%' q = H q {T/T^i' ) \ Q) ® x 
£ x E,Q). The result is given by: 

Lemma 19. For every [E] £ A\, the rational cohomology with compact support of 
the fibre of ft® (of" 1 ) — >• A\ , with its Hodge structures, is given by 



(H k c {T{o- { t 



(4)> 



\ExExE, 1 



Q(-5) 
Q(-4)® 2 
Sym 2 (H\E; 
Q(-3) 
Sym 2 (H^E; 




fc = 10, 
fe = 8 
-2) fc = 7, 
fe = 6 
k = 4, 
otherwise. 



Proof. We denote the generators of H l {T/T^i );Q) ~ ^((C*) 2 ; Q) Q 2 corre- 
sponding to £i" 3 ,t^2 by Q 2 ,Qs- The = 1, ... ,6 are, as before, a basis of the 
cohomology of the triple product E x E x E. 

We must now compute the action on (co)homology of the automorphisms of cr^. 
As a non-trivial example we shall do this in detail in the case of the transformation 
given in (6.7), the computations in the other cases are analogous. 

The action of this transformation on Siegel space is given by: 



A 














71,2 


7"1,3 7-1,4^ 




( l 















1 










Tl,2 


7"2,2 


7"2,3 72,4 







1 


-1 










-1 - 


-1 







71,3 


7-2,3 


7-3,3 7" 3j 4 










-1 



















\7"1,4 


7"2,4 


7-3,4 7-4 !4 y 




v> 








l ) 






f 


T M 






n,2 




-7-1,2 - 7-1,3 






n,4 




\ 






7-1,2 






7-2,2 




-7-2,2 - 7-2,3 






7"2,4 










-Tl,2 - 


71,3 




"7-2,2 - 


7-2,3 


72,2 + 2t 2 ,3 + T 3j3 




-7-2,4 - 


7-3,4 




y 


71,4 






7-2,4 




-7-2,4 - 7- 3i 4 






7-4,4 




J 
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From this we conclude that under this transformation: 

(6.11) Q 2 ^-Q 2 -Q 3 ; Q 3 ^Q 3 ; 

/»!->/») « = 1, . . . , 4 /jh> -/j_2 - /»; i = 5, 6, 

Note that the latter coincides with the transformation behaviour of the differentials 
dri t 4, i = 1,2, 3, and the former with the transformation behaviour of — ti ;3 , — Ti ;2 . 

An analogous computation for the other automorphisms gives the following re- 
sults: 

(6.12) Q 2 ,Q 3 ^ -Q 2 ,-Q 3 ; 

h,h ^ -/i,-/2, /»>->/», i = 3,...,6. 

(6.13) 02,Q3^Q 3 ,Q 2 ; 

/l , /2 /1 , / 2 , / 3 O / 5 , / 4 <-> / 6 , 

(6.14) Q 2 ,Q 3 ^Q 2 ,Q 3 ; 

fi^-fi, i = l,...,6. 

Now we must compute the invariant cohomology with respect to G((7j 4 '). This 
can either be done by a (lengthy) computation by hand or a standard computer 
algebra system. 

The -Ef' terms of the spectral sequence can be computed as follows. The in- 
variant part E^ of the cohomology group H a (T/T a< ^ ; Q) ® H 2 (E x E x E;Q) is 
two-dimensional and generated by the tensors 

h = h A f 2 , h = 2(/ 3 A / 4 + / 5 A / 6 ) + (/ 3 A / 6 + f 5 A / 4 ). 

The term E^' is also two-dimensional, with generators I\ A J 2 and I 2 A I 2 - The 
terms ~ iJ°(T/T ff / 4> ; Q) x £ x B;Q) and = # (T/T ff ' 4> ; Q) ® 

H 6 (E x E x E;Q) are one-dimensional and generated by fundamental classes. 

The term £ 2 '\ which is the invariant part of i? 1 (T/T <T ^ ) ;Q)®H 2 (E x E x E;Q) 
is 4-dimensional, with generators 

ffij - ((Q 2 + 2g 3 ) ® /j- +2 + (2g 2 + Q 3 ) /j+4) A /i, i,.? = 1, 2. 

In particular, it is isomorphic to H 1 ^;®) ® ^(.EjQ) = Sym 2 (i? 1 (£; Q)) © 
/\ 2 H 1 (E; Q). The term i?^' 1 is also four-dimensional and generated by (gjj A 7 2 ). 
All other E 2 ' vanish. 

Finally, the only non-trivial terms of the form E^' 2 are those with p — 2 and 
p = 4. The subspace £ 2 ' 2 C H 2 {T /T^ ;Q) ® H 2 (E x E x E;Q) is isomorphic to 
Sym 2 (7J 1 (i?; Q)) and is generated by the invariant tensors 

Q2 A Q 3 ® / 3 A / B , g 2 A Q 3 ® (/a A / 6 + / 4 A / 5 ), g 2 A Q 3 ® / 4 A / 6 . 

Finally, the subspace i?^' 2 is 4-dimensional and equal to _E 2 ' 2 A I\. 

In terms of local systems this gives rise to the Table 10. We claim that that 
the differentials d% q : E^ q -> £f +2 ' 9_1 for (p,q) = (2,1), (2, 2) and (4,1) are of 
maximal rank. Indeed, by Schur's lemma it is enough to prove that they are non- 
zero. To check this it is enough to recall that the torus bundle is isomorphic to 
p* 3 (V°) © pi 2 (P )- I n particular, for every class a € E^ 1 we obtain df' (a) by 
replacing Q 2 with Ci(p* )3 (7>)) = -(/1 A / 6 + f 5 A f 2 ) and g 3 with Ci(p\^{V)) = 
— (/1 A fi + / 3 A / 2 ) in the expression of a. Analogously, for every class (i £ E 2 ' we 
get d 2 /(P) by replacing Q 2 A g 3 with g 2 ® ci(pj i2 (7?)) - g 3 <8> ci(^ 3 (P)). Then 
the claim follows from a straightforward calculation. □ 
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Table 10. E 2 term of the spectral sequence converging to the 
cohomology of /3^(af ^) 
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To complete the proof of Lemma 18 is now an easy consequence of the Leray 
spectral sequence of the fibration p o q ( 4 ) : T{o~p ) — y A\ . Looking at the weights 
of the Hodge structures, we see immediately that all differentials must vanish and 
thus the result follows. □ 



6.4. The cohomology of /3§(er]y ). Before we can describe the cohomology of this 
stratum we must identify the toric bundle T{afj). 

Lemma 20. Let pi, 2 : E x E x E — > E x E be the projection onto the first two 
factors and let q : E x E x E — > E x E be the map given by q(x, y, z) = (x + y + z,z). 
Then 

where V° is the Poincare bundle over the product ExE with the 0- section removed. 

Proof. Since the generators of the cone afj correspond to T\,T 2l T^,T^ we can 

take Tq = an d T3 = £3,3^1,3^,3 as coordinates on the torus T/T^ a n \ In 
Lemma 17 we had seen that the action of the group generated by the matrices 53 
with M, N e 1? is as follows. For N = (m, n 2 , 713) we have 7-3,4 i-> r^ 4 + m and for 
M = (mi, m 2 , 7713) we have Tjj r^j + m.,T,,4 + rriiTj^ + miva^r^ for 1 < i,j < 3 
and Ti.4 1 — ^ Ti.4 + 772,74,4. In particular 

Ti,2 >-> 7-1,2 + m 2 7i,4 + m\T2A + mim 2 T4,4 

whereas 

(Tl,3 + T 2 , 3 + T 3 , 3 ) (n i3 + T 2 ,3 + 73,3) + 

"13(7-1,4 + 7- 2 ,4 + 73,4) + (mi + m 2 + m 3 )T 3 ,4 + m 3 (mi + m 2 + m 3 )T 4 ,4. 

A comparison with the transformation behaviour for the Poincare bundle described 
in Lemma 17 gives the claim. □ 

Lemma 21. T7ie rational cohomology groups with compact support of P^(a\ 4 j) are 
given by 

HM(v$);Q) = Q(-k/2), k = 10,12. 

Proof. As in the previous case we first have to describe the automorphism G(afj) 
of the cone afj . This group is the symmetric group S4 permuting the generators of 
the cone together with the map Xi h-> — Xi. Hence we can work with the following 
generators: 

(6.15) Xi n> — Xi, i = l,...,6 

(6.16) x x ox 2 , X3 i-> xi + X2 — X3 



(6.17) 



x\ \-> x\ - X3, x 2 ^-x 2 , x^ 1 y X3 
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(6.18) 2i M> X 3 — X 2 , X 2 ^-X 2 , X3*-^Xi—X2- 

We now have to compute the induced action of these automorphisms on the coho- 
mology groups H'{T/T^ ); Q) ®H*{E xExE;Q). To this end, we denote by Q 3 
(respectively, R) the generator of H l {T/T^ a n ); Q) corresponding to the parameter 
Te = tx\ (respectively, to T 3 = £1,3*2,3*3,3)- 

It is immediately clear that in the case of (6.15) the action is given by 

(6.19) Q 3 ,R^Q 3 ,R; 

fi^-fi, i = l,...,6. 
We note that this implies that there can be no non-trivial invariant cohomology 
classes involving terms of odd degree in H*{E x E x E). Next we claim that the 
action on cohomology of (6.16) is given by 

(6.20) Qz^Qz-R, R^ -R 

fi i-> fi+2 + fi+4, i = 1, 2; /j4 fi-2 + fi+2, i = 3, 4; /* i-> -/», 
To see this we compute 



5,6. 



/o 

1 




\0 

/* 

V* 



-1 



0\ /ri,i ri )2 
ri,2 t 2i2 

Ti,3 72,3 
1/ \Tl,4 72,4 

T"l,2 + 72,3 + n,3 + 73,3 



71,4^ 
72,4 
7"3,3 T 3i 4 
7"3,4 T4,4/ 



n,3 

7"2,3 



/o 
1 
1 






-1 








-72,3 — 7-3,3 
-7"1,3 - 7-3,3 

7-3,3 



1/ 

+■ T 3,4\ 



72,4 
7"1,4 + 7-3,4 
-7- 3 ,4 
7-4.4 



This immediately gives the claim for the /j. For Q 3 , R we observe that the action 
induced on the homology is dual to the action on the subspace (—7-1,2, 7-1.3 + 72,3 + 
73,3. Since cohomology is dual to homology, the action on Q 3l R agrees with that 

on -7-1,2,7-1,3 + 72,3 + 7-3,3- 

A similar calculation gives the following results in the remaining cases: 

(6.21) Q 3 i-> -Qs, R ^ -Qz + R; 

fi !-> fi, i = 1, 2; /j4 -/,, i = 3, 4; /, ^ -/j_ 4 - f u i = 5, 6. 

(6.22) Q 3 <-> i2; 

/. ^ fi+4, i = 1, 2; /i i-> -/i_2 - /» - /i+2, « = 3, 4; /ji-> / 4 _ 4 , i = 5, 6. 



It is now straightforward to compute the invariants under G(ajj 



In the coho- 



mology group ^°(T/T( ff ");( 
namely 



H 2 (E x E x E 1 ; Q) we find one invariant tensor, 



where we denoted tp 
Inii^T/T^^Q)^ 



h =3(/iA/2 + / 3 A/ 4 ) + 2^ + V, 
= (/i + /3 + / 5 )A/6 + / 5 A(/2 + /4 + /6) and^ = /1A/4 + /3A/2. 
)H 2 (E x E x E;Q) we also obtain one invariant tensor, namely 

I 2 = -i? ® (2(^ + -0) + <g> (v? + 2r/»). 

The invariant class in H°(T/T^^; Q) ® # 4 (£ xBx£;Q) is /1 A 7i and in 
H 1 {T/T ( - a< i l i ) '>; Q)(g>H 4 (ExExE; Q) it is J 2 A/l. This together with the fundamental 

classes in H°(T/T^^; Q) ® if°(£ x E x E;Q) and H°(T /T^h; Q) ® i7 6 (£ x 
E x E;Q) are the only invariants. 

As before we now look at the Leray spectral sequence in cohomology associated 
with p o 9^(4) : T(o-jj^) — > Al. Since all representations are trivial we thus obtain 
Table 11. Hence, we have two differentials which could be non-zero, namely 
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Table 11. E 2 term of the spectral sequence converging to the 
cohomology of P 3 {o^j) 



q 
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4' 1 : H^T/T^i' ~>;Q)(g)H 2 (ExExE;Q) -> H°(T/T {a " ' ;Q)®H 4 (E x E x E;Q), 
resp. 

4 1 : H 1 (T/T (rT i i ' )) ;Q)(g)H 4 {ExExE;Q) H°(T/T^^; Q)(g>H 6 (E xExE;Q). 

Indeed we claim that they do not vanish. For this we use the description of 
Ti&i^^ExExE given in Lemma 20. It follows from this description that this bundle 
splits into the product of two factors with Euler classes — ip and tf). The claim that 
the first differential is non-zero is now equivalent to 

Lp A (2(p + tp) + V> A (ip + 2ip) ^ 0. 

For the second differential we must check that 

(ip A (2tp + V>) + ip A (ip + 2ip)) Ah^O. 

This can be checked by direct calculation. At the same time this proves that the 
first differential does not vanish. The claim of the lemma now follows immediately 
after converting to cohomology with compact support. □ 

6.5. The cohomology of /3§(er (5) ). 

Lemma 22. The rational cohomology groups with compact support of (3 3 (a^) are 
given by 

( Q(-k/2) k = 6, 10 

# c fc (/3 3 V 5) );Q) = I Q(-fc/2)® 2 fc = 8 

[ otherwise. 

Proof. We first have to compute the automorphism group G(a^). It is not hard 
to see that this group is generated by the transformations 

(6.23) i-> -ij, i= 1,2,3 

(6.24) x\ «-> X2, x 3 M> x 3 

(6.25) xiH>xi-x 3 , X2 i->- X2 - x 3 , x 3 i-> -x 3 

(6.26) x\ i-> #1 — 2:3, x 2 M> — a; 2 , £3 >-> — #3- 

A computation analogous to that in Lemma 18 shows that this results in the fol- 
lowing action on cohomology, where again we denoted by /j the generators of the 
cohomology of E x E x E and by Q 3 the generator of the cohomology of the fibre 
of the torus bundle: 



(6.27) 
(6.28) 



fi ^ ~fi, « = 1, • • • , 6; Q 3 i-> Q 3 
ft «-> fi+2, i = 1, 2; 1 ^ /j , j = 5, 6; Q 3 i-> Q 3 
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Table 12. E 2 term of the spectral sequence converging to the 
cohomology of (3^(a^) 



q 








1 






Q d 


Q(-2) 

2(-i)® 2 o ( 


Q(-3) 
2(-2)® 2 Q(-3) 
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2 3 


4 5 6 p 



(6.29) fi !->• f h i = 1,...,4; fk ^ ~fk-4 - fk-2 - fk,k = 5,6; Q 3 n> Q 3 
(6.30) 

/» ^ /», « = 1, 2; /j i-> = 3, 4; f k i-> -/ fe _4 - / fe , fc = 5, 6; Q 3 i-> -Q 3 . 

Next, we compute the invariant cohomology in H°(C*; Q) ®H 2k (E x E x E;Q). 
Clearly this is 1-dimensional for fc = 0, 6. By duality it is enough to do the com- 
putation for k = 2. Here we find a 2-dimensional invariant subspace generated by 
h ■= /1A/2+/3A/4 and^2 := /1 A/ 4 +/3A/ 2 +2(/ 1 +/3+/ 5 )A/ 6 +2/ 5 A(/2+/4+/6). 

In this situation we also have invariant cohomology in 7? 1 (C* ; Q) <g> if 2 (E x E x 
E; Q). This is 1-dimensional and generated by Q 3 <g) (/1 A fi + A / 2 ). By duality 
we also have a 1-dimensional invariant subspace in iJ 1 (C*) <8> H 4 (E x E x E). A 
standard calculation shows that this is generated by Q 3 A {fx A /4 + / 3 A / 2 ) A i 2 . 

In this case the differentials in the Leray spectral sequence are not automatically 
0. The situation is described in Table 12. here are two differentials which we have 
to consider. These are: 

d 2 / : H 1 (C*;Q)^H 2 (E x E x E; Q) -> H° (C* ; Q) <g> H 4 (E xEx E;Q), 

resp. 

4' 1 : H 1 (C*;Q)^H 4 (E x E x E; Q) -> H° (C* ; Q) ® H 6 (E xEx E;Q). 

We claim that both differentials are non-zero, i.e. they have rank 1. We first 
treat (4' 2 . The differential is given by taking the cup-product with the first Chern 
class of the vector bundle spanned by the torus bundle T(ct^)\exExe- As in 
previous cases on can see that T{o-^)\exExe ~Pi2(P°)- This shows that 

4' 2 : <23®(/iA/ 4 + / 3 A/ 2 )^ 
(fi A h + h A h) A (/1 A U + h A / 2 ) = 2/i A / 2 A / 3 A / 4 ^ 0. 
The argument for c^' 4 is analogous. Finally we use the duality (/3 3 (c^); Q) = 
#10-/^0^(5)). q)* Q(_5) (which holds on finite smooth covers) to obtain the 
claim. 

□ 

6.6. The cohomology of /3°(cr (6) ). 

Lemma 23. The rational cohomology groups with compact support of 0^{a^) are 
given by 

Q(-fc/2) k = 2,4,6,8 



^(/3 3 V 6 >);Q) = j ? 



otherwise. 



Proof. The proof of this lemma is analogous to the other cases. We first note that 
the automorphism group of G(a^) is generated by the symmetric group in three 
variables permuting the coordinates Xi (i = 1,2,3) and the transformations (6.23) 
and (6.25) already considered in the previous section. In this case the torus rank 
is and hence it suffices to compute the action on the cohomology of the triple 
product E x E x E. In view of the transformation (6.23) there is no invariant 
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Table 13. Gysin spectral sequence converging to the cohomology 
with compact support of /?§ 
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in odd degree. By duality it is enough to compute the invariant cohomology in 
H 2 {E x E x E;Q). A straightforward calculation shows that this is 1-dimcnsional 
with generator 2v 1 + v 2 + v 3 , with v 1 = /i A f 2 + h A fi + h A / 6 , v 2 = fi A f 4 + 
fa A h + h A h and v 3 = ft A f 6 + f 3 A f 2 + f 5 A / 4 . □ 

6.7. The cohomology of f3 3 . In this section, we will use the computations on the 
strata of (3 3 to prove the following result. 

Proposition 24. The rational cohomology with compact support of f3 3 is as follows: 
the non-zero Betti numbers are 
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One has if 7 (/3°; Q) = Q(-l) and # C 5 (/3°;(Q)) = Q. Furthermore all cohomology 
groups of even degree are algebraic. 

Proof. We consider the Gysin spectral sequence associated with the stratifica- 
tion of given by the locally closed strata Wi = /^(e^ 6 '), W 2 = /3°(er (5) ), 
W 3 = ^{o-f ) )U^{af I > ) and W 4 = ^§(cr (3) ). We set Y p = W p . This is the spectral 
sequence EV ^ HP+i(^ 0) ;Q) with Ef' q = HP +q (Y p \ F p _i;Q) = H^(W P ;Q). 
The cohomology with compact support of the strata W, was computed in the 
Lemmas 15, 18, 21, 22 and 23. In view of these results, the E\ term of the 
Gysin spectral sequence is as given in Table 13. We consider the differentials 
d™ : EP'i -)■ EP+ r 'i- r+1 . Inspection of Table 13 shows that the only possible non- 
zero differential is d 3 ' 5 : £ 3 ' 5 = H^(f3^(a\ 4) );Q) ->• E^ b = # c 9 (/3°(cr( 3 )); Q). We can 
interpret this differential as arising from the Gysin long exact sequence associated 
with the inclusion of /3g(cr| 4 ^ in the partial compactification j5 3 {a^) U /^(cj 4 ') of 
^(o-^). Let us denote by * E the fibre of the fibration f3°(a^) U /^(ct[ 4) ) -> Ai 
over a point [E] € Ai . Thanks to the Leray spectral sequence associated with that 
fibration, all we need to know is that the cohomology with compact support of ^ e 
vanishes in degree 7. This requires to prove that the differential 

d 7 : Hl{{p o q af ) )-\[E))- 0) -> tf c 8 ((p o q a(3) ^([E]); Q) 

in the Gysin long exact sequence associated with (p o g ff(4 ) C is an 
isomorphism. 
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Since in the proofs of Lemma 17 and Lemma 19 we described the generators of 
the cohomology of the fibres of E rather than those of the cohomology with compact 
support, we shall analyze the map induced by df on cohomology by Poincare duality, 
whose rank coincides with that of dr. Let us recall that the inclusion of {0} x (C*) 2 
in C x (C*) 2 induces a Gysin long exact sequence whose differentials define the 
maps 

H k ((C*) 2 ;Q) <g>Q(-l) — ► H k+1 ((C*) 3 ;Q) 

T t .— > Ti A Ti i = 2,3. 

As a consequence, the differential H 3 ((p o q (4) Q) <g) Q(-l) -> H 4 ((po 

q cr (3))~ 1 ([E]); <Q>) maps each of the generators gij described in the proof of Lemma 19 
to the class obtained by replacing T 2 by T2 A T\ in the expression, and then sym- 
metrizing for the action of the group G(<7^). This yields: 

2 x - 

9i,j ' > g 2-^, Qfc+i A Q'+i ® hk+i A f2l+j, 

0<k,l<2 

hence in particular the differential is surjective. From this the claim follows. 

□ 



7. Torus rank 4 

In this section we compute the cohomology of the closed strata [3 4 C Aj 01 and 
/3ij >cr± C A^ cri of torus rank 4 in the second Voronoi and the perfect cone compact- 
ification, respectively. 

We shall first state the main results: 

Theorem 25. The cohomology groups with rational coefficients of the closed sire- 
tum/3l crt C Af rt of the perfect cone compactification of the moduli space of abelian 
varieties of dimension 4 are non-zero only in even degree. The only non-zero Betti 
numbers are bo = 02 = &4 = 1, &6 = °s = 4, bio = 3 and 612 = 1. 

The cohomology is algebraic in all degrees different from 6, whereas H 6 {l3\ evi ; Q) 
is an extension of Q(— 3)® 3 by Q(— 1). 

The closed stratum ($4 C Aj° r has two irreducible components: a nine-dimen- 
sional component E, which is the exceptional divisor of the blow-up q: A\ or — > 
A^ elf , and a six-dimensional component, which is the proper transform of (3^ eri 
under q. 

Theorem 26. (1) The rational cohomology of E is all algebraic. The only 
non-zero Betti numbers are bo = b 2 = &16 = 6is = 1, 64 = 614 = 2 and 
be = b s = b w = 612 = 3. 
(2) The rational cohomology of (5 4 is non-trivial only in even degree. The non- 
zero Betti numbers are 
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All cohomology groups are algebraic, with the exception of H 6 (/3 4 ; Q) , which 
is an extension of Q(— 3)® 6 by Q(— 1). 

7.1. Cone decompositions. It is in this section that we require full information 
about the perfect cone or first Voronoi and the second Voronoi decomposition in 
Sym^QR 4 ). Details concerning these decompositions can be found in [ER1] , [ER2] , 
[Val] and [Vor]. We start by recalling the perfect cone decomposition. The starting 
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point is two 10-dimcnsional cones, namely the principal cone III (4) and the second 
perfect cone n 2 (4). These cones are given by 

IIi (4) = (xl,x%,xl,xl, (x! - x 2 f, (xi - x 3 ) 2 , (xi - x A ) 2 , (x 2 - x 3 ) 2 , 
(x 2 - x 4 ) 2 , (x 3 - x 4 ) 2 ) 

and 

n 2 (4) = {x%,x%,x%,xl, (x! - x 3 ) 2 , (x! - x 4 ) 2 , (x 2 - x 3 ) 2 , (x 2 - x A ) 2 , 

(x 3 - x 4 ) 2 , (xi +x 2 - x 3 ) 2 , (xi + x 2 - x 4 ) 2 , {xi + x 2 -x 3 - Xi) 2 } 

respectively. The perfect cone decomposition consists of all GL(4, Z)-translates of 
these cones and their faces. While the cone IT (4) is basic, the cone n 2 (4) is not, 
hence it defines a singular point Ping G A^ crf . Nevertheless, all 9-dimensional faces 
of Il2(4) are basic. Modulo the action of GL(4, Z) these 9-dimensional faces define 
two orbits. Traditionally these are called RT (red triangle) and BF (black face) 
respectively (see [ER2]). 

In genus 4 and 5 (but not in general) the second Voronoi decomposition is a 
subdivision of the perfect cone decomposition. In our case it is the refinement of 
the perfect cone decomposition obtained by adding all cones that arise as spans of 
the 9-dimensional faces of U 2 (4) with the central ray generated by 

(7.1) 

e = 3 [ X l + X 2 + x l + x l + ( x l - X ?>f + ( x l ~ x i) 2 + ( x 2 - X 3 ) 2 + (x 2 - Xi) 2 

+(x 3 - x 4 ) 2 + (x 1 + x 2 - x 3 ) 2 + (xi + x 2 - x 4 ) 2 + (xi + x 2 - x 3 - Xi) 2 ] . 

In particular, all perfect cones, with the exception of 112(4), belong to the sec- 
ond Voronoi decomposition. Geometrically this means that A\ or is a blow-up of 
A p 4 crl = A\ su in the singular point P s i ng . Since all cones on the second Voronoi 
decomposition are basic Aj m is smooth (as a stack). Moreover, the exceptional 
divisor E is irreducible and smooth (again as a stack). (For a discussion of this see 
also [HS2]. 

A description of representatives of all GL(4, Z)-orbits of cones in the second 
Voronoi, and hence also the perfect cone decomposition, can be found in [Val, 
Chapter 4]. For cones with extremal rays spanned by quadratic forms of rank 1 
the list is given in [Val, S.4.4.4]. Note that in this list K§ denotes the cone 112(4), 
and the 9-dimensional cones K 5 — l and K 3t3 correspond to the equivalence classes 
BF, respectively, RT of [ER2]. The remaining cones are listed in [Val, S.4.4.5]. The 
following list gives the number of GL(4, Z)-orbits of cones in each dimension for the 
two decompositions. 



dimension 
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# perfect cones 
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# second Voronoi cones 
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3 



From this we see that the perfect cone decomposition has 26 different cones, whereas 
the second Voronoi decomposition has 60 different cones. The lists in [Val] also allow 
us to write down generators for the extremal rays of representatives in all cases. 

7.2. Plan for computation. We briefly recall the structure of (3i and /?4 erf which 
comes from the toroidal construction. More generally, let (3f be the stratum of any 
admissible fan E (in our case either the perfect cone or the second Voronoi fan), 
then each cone a G S defines a torus orbit T a of dimension 10 — k where k is the 
dimension of a. Let G a C GL(4, Z) be the stabilizer of a with respect to the natural 
action of GL(4, Z) on Sym> (R 4 ). Then G a acts on T a and j3f is the disjoint union 
of the quotients Z a = T a /G a where a runs through a set of representatives of 
all cones in £ which contain a form of rank 4 in their interior. We then define 
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a stratification by defining S p as the union of all Z a where dime > 10 — p. In 
particular, S p \ S p ~i is the union of all Z„ with dim a = 10 — p. 

The Gysin spectral sequence E p . q => HP+i (/3f rf '; Q) = rf ; Q) associated 

with the filtration S p has E\ term given by 

£f 9 = HP +q (S p \ Sp-uQ). 
Since S p \ 5 p -i is the disjoint union of the Z a with dimer = 10 — p it follows that 

# C *(S P Wi;Q)= ^ C *(^;Q). 

dim cr 

In our situation we have considerably more information. In particular we know 
that, with the exception of n 2 (4), all cones in both the perfect cone and the second 
Voronoi decomposition, are basic. In particular all strata S p with p < 9 are locally 
quotients of a smooth variety by a finite group. Moreover T a = (C*) 10 mcr an( j 
Z a = (C*) 1 °- dim, 7G (T . The torus orbit of n 2 (4) is a point. Thus we have to 
compute for each cone cr the cohomology of the torus T a with respect to G a . Recall 
that H'((C*) k ;Q) is the exterior algebra generated by the fc-dimcnsional vector 
space H 1 ((C*) k ; Q). Moreover, a basis of the vector space ff 1 ((C*) fc ;Q) can be 
obtained by taking the Alexander dual classes of the fundamental classes of the 
components 

{(yi,---,yk)\yi = o}, i = i,...,k 

of the complement of (C*) fe in C fc . This means that, once the generators of the cone 
a and of the group G are known, the computation of the cohomology of Z a reduces 
to a linear algebra problem, which can be solved using computational tools. In our 
case, the generators of the stabilizers G a were calculated with Magma ([BCP]) and 
the invariant part of the algebra A* H 1 ((C*) k ; Q) with Singular ([GPS]). 

7.3. Perfect cones. We shall now perform the programme outlined above for the 
perfect cone compactification, which coincides with the Igusa compactification in 
genus 4. We have already mentioned that a list of representatives of all cones in the 
perfect cone decomposition, together with their generators, can be found in [Val, 
Ch. 4] . This enables us to compute the stabilizer groups G a as well as the invariant 
cohomology of the torus orbits T a = (C*) k where k = 10 — dimer. The results so 
obtained are listed in Table 14, where the notation for the cones is the one of [Val, 
§4] . The information on the cohomology of the strata is given in the form of Hodge 
Euler characteristics, i.e. what is given is the Euler characteristic of H'(Z a ;Q) in 
the Grothendieck group of Hodge structures. The symbol L denotes the class of the 
weight 2 Tate Hodge structure Q(— 1) in the Grothendieck group. The relationship 
between cohomology and cohomology with compact support is given by Poincare 
duality: 

H l c (Z a ;Q) - Uom(H 2k ~ l (Z a ; Q), Q(-fc)), 

which holds since the Z a are finite quotients of the smooth varieties T a . 

In view of the information on the cohomology of the Z a given in Table 14, this 
yields that the E\ terms of the spectral sequence El' 9 => H p+q {j3\ crf ; Q) are as 
shown in Table 15. 

To establish Theorem 25, we need to determine the rank of all differentials in 
the spectral sequence. As morphisms between pure Hodge structures of different 
weights are necessarily trivial, one remains with five differentials to investigate, all 
of the form d\' q : E{' q -> E p+1 ' q . We will denote them by 

S : E^^El' , S' : E*'° — >■ E\' Q , 

Sf. El' 1 — + El' 1 , 5 2 : El' 2 E^' 2 , S 3 : E^' 3 — -» E*' 3 . 

Lemma 27. All the differentials So , 5' a , 5i , S2 and S3 have rank 1. 
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Table 14. GL(4, Z)-orbits of perfect cones 



s 


dim £ 


eHdg(-^s) 




dim£ 


eHdg(-^s) 


#5 = 11! (4) 


10 


1 


#4 + 1 


7 


L 3 


n 2 (4) 


10 


1 


C222 


6 


L 4 - L 3 


#5-1 


9 


L 


C321 


6 


L 4 + l 


#3,3 


9 


L 1 


C221 + 1 


6 


L 4 


#5-2 


8 


L 2 


C3 + C3 


6 


L 4 


#5-1-1 


8 


L 2 L 


C 5 


5 


L 5 -l 


#5-2-1 


7 


L 3 - L 2 


C4 + I 


5 


L 5 


C222I 


7 


L 3 


c 3 + 1 + 1 


5 


L 5 +L 


#5-3 


7 


L 3 


1+1+1+1 


4 


L 6 



Table 15. E\ term of the spectral sequence converging to H'(Pl er ;Q). 



<7 
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2(-6) 


5 














( 


K-5)® 3 





4 











( 


K-4)® 4 








3 








( 


K-3)® 4 


Q(-3) 








2 





( 


K-2)® 2 


Q(-2) 











1 





Q(-l) 02 

Q 


















Q©2 








Q 


Q 










1 


2 


3 


4 


5 


6 



Proof. Since /3£ crf is connected, one has #°(/3f;Q) = Q. This implies that <5 
has rank 1. 

Next, we consider the differential 6' : E*'° = Q — >■ £f'° = Q. From the 
description of the strata given in Table 14, we have E^'° = H^(Zc 321 ;Q) and 
E b {° = # C 5 (Z C5 ;Q) for the cones 

C 5 = (x\,xl.{x-i - x 4 ) 2 , (x 2 - X3) 2 , {x 3 - x 4 ) 2 ), 
C321 = (x\,x\,x\, (xi - x 4 ) 2 , (x 2 - x 3 ) 2 , (x 3 - x 4 ) 2 ). 

The cone C5 is contained in C321, hence Zc 321 is contained in the closure of 
Zc 5 - Furthermore, the rank of S' must coincide with the rank of the differential 
rjo- # 4 (Zc 321 ;Q) — > H^(Zc 5 ;Q) of the Gysin long exact sequence associated with 
the inclusion of Zc 321 in the partial compactiheation Zc 5 U Zc 321 of Zc 5 - 

If one considers the stabilizers, one observes that Gc 321 is a subgroup of Gc 5 - 
Therefore, one can view 770 as a map from the cohomology of (C*) 4 to the coho- 
mology of (C*) 5 in the following way: 

# 4 (Z C321 ;Q) = # C 4 ((C*) 4 ;Q) G -3 21 

H 5 c (Zc 5 ;Q) = #5((C*) 5 ;Q) G ^ = H 5 C ((C*) 5 ; Q) G ^ , 

where we used the fact that the Gc 321 -invariant part of #^((C*) 5 ;Q) coincides 
with the Gc 5 -invariant part. This new interpretation relates the map ij to the 
differential 



(7.2) 



# 4 ((C*) 4 ; Q) = Q — ► #c((C*) 5 ;Q) = Q 
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of the Gysin exact sequence of an inclusion (C*) 4 4Cx (C*) 4 , with complement 
isomorphic to (C*) 5 . In particular, since H*(C x (C*) 4 ;Q) vanishes for k < 5, the 
differential (7.2) is an isomorphism, and the same holds for rjo- 
Let us consider the differential 

<fi : E^ 1 = HKZk^-Q) © H^(Z Ka , a ]Q) -> E 2 ' 1 = Hl(Z Ks -\-K Q). 

Note that both Zk b -i and Zk 3 3 are contained in the closure of Zk 5 -i-i C /?4 6rf . 
We choose to investigate the inclusion 2 3j3 of Zk 3 3 in the partial compactification 
Zk 3i3 U Zjf 5 _i_i of Z^ 5 _i_i. Then the rank of #i cannot be smaller than the rank 
of the differential 

r?! : H 2 (Z K33 ;Q) — ► ff c 3 (Z* B _i_i;Q) 

in the Gysin long exact sequence associated with i 3i3 , even though there is no 
canonical isomorphism between the kernel of r/i and that of Si. 
In Vallcntin's notation, the cone K 33 is given by 

K3.3 = {xl,xl,xl,x% {xi - x 3 ) 2 , (xi - x 4 ) 2 , (x 2 - x 3 ) 2 , (x 2 - x 4 ) 2 , 
(xi + x 2 - x 3 - x 4 ) 2 ). 

In particular, its subcone 

#5-1-16= (x\,x%,x\,x\, {xi - x 3 ) 2 , (xi - a; 4 ) 2 , (x 2 - x 3 ) 2 , (z 2 - Xi) 2 ) 

belongs to the same GL(4, Z)-orbit as #5 — 1 — 1, so that Zk 5 -i-u C /?4° rf coincides 
with Zjf B _i_i. The stabilizer G^-i-ift 01 the cone K$ — 1 — 16 is generated by 
— Id Z 4 and by the two automorphisms 

ari h-> .x 3 f .Ti 

.t 2 h-> a; 4 , x 2 \-t x 2 
< and < 

x 3 i-> a; 2 2:3 !->■ £4 

^ £4 H> xi [ 

In particular, one can check that the group Gjc b _i_i& is contained in the stabi- 
lizer Gk 3 3 of the cone # 3>3 . 

Analogously to the case of 770, we can reduce the study of 771 to the study of the 
long exact sequence of an inclusion C* H> C x C* with complement isomorphic to 
(C*) 2 , by exploiting the diagram 

H 2 {Z K33 ;Q) = #!(C*;0) G *3,s = H 2 (C*; Q)G*.-i-« 

g c 3 (Z g5 -i-i b ;Q) = ffg((C*) 2 ;Q) G *.-i-». 

Then the claim follows from the fact that the differential F 2 (C*;Q) = Q(-l) ->■ 
i7 3 ((C*) 2 ; Q) in the Gysin long exact sequence associated with the inclusion C* 
C x C* has rank 1. 

The proof for S 2 and <5 3 is completely analogous to that for Si . In the case of S 2 
one considers the inclusion of the 2-dimensional stratum Zk 5 - 2 in the 3-dimcnsional 
stratum Zk 5 -2-i, given by the inclusion of the cone 

K 5 - 2 - 16 = {x\,x\,x\, (xi - x 4 ) 2 , (x 2 - x 3 ) 2 , (x 2 - x 4 ) 2 , (x 3 - x 4 ) 2 ), 

which lies in the same GL(4, Z)-orbit as K 5 — 2 — 1, in 

K 5 - 2 = (x 2 ,x 2 ,x 2 ,x 2 , (xi - Xi) 2 , (x 2 - x 3 ) 2 , (x 2 - x 4 ) 2 , (x 3 - x 4 ) 2 }. 

In this case, the stabilizers of K 5 — 2 and of #5 — 2 — 16 coincide as subgroups of 
GL(4,Z). 
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In the case of S3, one considers the inclusion of the 3-dimcnsional stratum ^2221 
in the 4-dimensional stratum Zc 222 > given by the inclusion of the cone 

C222 = (x\,xl,x\, (X! - X 4 ) 2 , (x 2 - X 4 ) 2 , (x 3 - X 4 ) 2 ) 

in 

C2221 = {x\, x\, x\,x\, (xi - x 4 ) 2 , (x 2 - x 4 ) 2 , (x 3 - X4) 2 ). 
Again, the stabilizers of C222 and C2221 coincide. □ 

7.4. Cones containing e. We shall now prove Theorem 26. 

Proof of (1)=>(2) in Theorem 26. Assume that the cohomology with compact sup- 
port of the exceptional divisor E of the blow-up A4 01 — > J^ crf is as stated in (1). 
The Gysin long exact sequence associated with the closed inclusion E C #4 is as 
follows: 

(7.3) ■••-». H k c ~\E- Q) ^ H k c {[34 \E;Q)^ H^: Q) -+ H k (E: Q) -> ■ • • 
Similarly the Gysin sequence of the pair {P sing } C /3f rf reads 

• • • -> H k c -\P sinz - Q) -> ^(/3f rf \ {P sing }; Q) -+ 
-+ P c fe (/3 4 pcrf ; 0) -+ P c fc (Pi„ g ; Q) -> • • • 

Since ij™ — J> „4 pcrf is an isomorphism outside the complement $4 \ E 1 is isomor- 
phic to /3 pcrf \ {Psing}- By Theorem 25 the odd cohomology with compact support 
of (3l crt vanishes and hence P c fe (/3f rf \ {P s i ng };Q) = P c fe (Ai \ E;Q) = for odd 
fc > 3. Moreover, \ {P sing };Q) = \E;Q) = since P sing is a point 

and [3^ crf is compact (which implies that cohomology with compact support and 
ordinary cohomology coincide). 

Furthermore by the description of H'(E;Q) from (1) we know that all odd 
cohomology of E vanishes. This ensures that all differentials d^,k > 1 are zero. 
This implies that the Betti numbers bk of /?4 with k > 1 are as stated in Theorem 26. 
Also the description of the Hodge structures follows from Theorem 25 and from 
part (1) in view of the long exact sequence (7.3). Finally, the fact that i?°(/?4; Q) is 
one-dimensional follow from the connectedness of $4. To complete the proof, recall 
that Pa is compact, so that cohomology and cohomology with compact support 
agree. □ 

Lemma 28. For every k, the cohomology group H k (E;Q) carries a pure Hodge 
structure of weight k. 

Proof. To prove the claim, we consider the second Voronoi compactification Aj OT (n) 
of the moduli space of principally polarized abelian fourfolds with a level-n structure 
(n > 3). Recall that A\ m {n) is a smooth projective scheme and that the map 
ir(n): Aj OI (n) — > Aj 01 is a finite group quotient. The preimage 7r(n) -1 (P) of E 
is the union of finitely many irreducible components, all of which are smooth and 
pairwise disjoint. This follows from the toric description, since these components 
are themselves toric varieties given by the star Star((e)) in the lattice Sym 2 (Z 4 )/Ze. 

In particular, this implies that the Hodge structures on the cohomology groups 
of n(n)^ 1 (E) are pure of weight equal to the degree. As ir(n) is finite, the pull-back 
map 

An)\l {n) -i {E ) ■■ H k (E; Q) -> H k (ir(ny 1 (E);Q) 

is injective. This implies that each cohomology group H k (E;Q) is a Hodge sub- 
structure of H k (Tr(n)~ 1 (E);Q), thus yielding the claim. □ 
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Table 16. GL(4, Z)-orbits of cones of dimension > 6 containing e 



(J iAlLLL (J 


Ctt , (7 \ 


a dimcr 


Pl , . (7 \ 

e Hdgl^er,l 


111+ 10 


1 


321- 


7 


L 3 - 2L 2 + L 


111- 10 


1 


222' 


7 


L 3 - L 2 


211+ 9 


L - 1 


22'2" 


7 


L 3 


211- 9 


L 


222+ 


7 


L 3 


311+ 8 


L 2 L 


222- 


7 


L 3 


311- 8 


L 2 


421 


6 


L 4 - L 3 + L 2 - L 


22' 1 8 


L 2 L 


331+ 


6 


L 4 + l 


221+ 8 


L 2 


331- 


6 


L 4 - L 3 - L + 1 


221- 8 


L 2 + L 


322+ 


6 


L 4 - L 3 


411 7 


L 3 - L 2 


322- 


6 


L 4 - L 3 


321+ 7 


L 3 - L 2 + L - 1 


322' 


6 


L 4 - 2L 3 + 2L 2 - 2L + 1 



Table 17. GL(4, Z)-orbits of cones of dimension < 5 containing e 



s 


dim £ 


e H dg(^ CT ) 


422' 


5 


L 5 + L 3 - L 2 + L 


332- 


5 


L 5 - L 4 + L 3 - 3L 2 + 2L 


431 


5 


L 5 - L 4 + L 3 - L 2 + L - 1 


422 


5 


L 5 - L 4 


332+ 


5 


L 5 - 2L 4 + L 3 - L 2 + 2L - 1 


432 


4 


L 6 - 2L 5 + 2L 4 - 4L 3 + 5L 2 - 2L 


333- 


4 


L 6 + 2L 2 


441 


4 


L 6 + L 2 


333+ 


4 


L 6 - L 5 - L 3 + 2L 2 - L 


433 


3 


L 7 - L 6 + L 5 - L 4 + 4L 3 - 4L 2 


442 


3 


L 7 + 2L 3 - L 2 


443 


2 


L 8 + 2L 4 - 3L 3 


444 


1 


L 9 -L 4 


TOT. 




L 9 + L 8 + 2L 7 + 3L 6 + 3L 5 + 3L 4 + 3L 3 + 2L 2 + L + 1 



Proof of (1) in Theorem 26. In view of Lemma 28, determining the cohomology of 
E is equivalent to computing its Hodge Euler characteristics, i.e. 

e H d g ( J B) = ^(-l) fe [ J ff c fc ( J B;Q)], 

feez 

where [•] denotes the class in the Grothendieck group KoCHSq) of Hodge structures. 
Hodge Euler characteristics are additive, so we are going to work with a locally 
closed stratification of E and add up the Hodge Euler characteristics to get the 
result. 

The toroidal construction of Aj or yields that E is the union of toric strata Z a for 
all cones a belonging to the second Voronoi decomposition but not to the perfect 
cone decomposition. Note that for such a the variety Z„ automatically maps to Ao 
under the map A^ m — > Af at . Furthermore, up to the action of GL(4,Z), one can 
assume that these cones contain the extremal ray (e) defined in (7.1) as extremal 
ray. 

Since cones that lie in the same GL(4, Z)-orbit give the same variety Z a , we have 
to work with a list of representatives of all GL(4, Z)-orbits of cones fulfilling our 
conditions. Such a list is given in [Val, §4.4.5]. As in the proof of Theorem 14, 
we compute for each cone a in Vallcntin's list the generators of its stabilizer G a 
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in GL(4,Z), as well as their action on i/ 1 ((C*) 10 ~ dimcr ; Q). Then we use the com- 
puter algebra program Singular [GPS] to calculate all positive Betti numbers of the 
quotient Z a = (C*) 10 ~ dlmcr /G cr . The results are given in Tables 16 and 17, where 
we list all cones and the Hodge Euler characteristics of the corresponding strata of 
E. 

As already explained, the Hodge Euler characteristic of E is the sum for the 
Euler characteristics of all strata Z a and is computed at the bottom of Table 17. In 
view of Lemma 28, and recalling that L is the notation of the weight 2 Tate Hodge 
structure Q(— 1) in the Grothendieck group of rational Hodge structures, we can 
conclude that the Betti numbers of E agree with those given in the statement of 
Theorem 26. □ 

Remark 29. Note that the Betti numbers of E satisfy Poincare duality. Indeed, 
this must be the case as E is smooth up to finite group action. 

Appendix A. Cohomology of A3 with coefficients in symplectic local 

SYSTEMS 

In this section, we recollect the information on the cohomology of local systems 
on Ai and A3 that we used in the course of the paper. Let us recall that the 
cohomology of local systems of odd weight on A g vanishes because it is killed by 
the abelian involution. Therefore, we only need to deal with local systems of even 
rank. 

The cohomology of A2 and ^3 with constant coefficients is known. The moduli 
space A2 is the disjoint union of the moduli space M 2 of genus 2 curves and the 
locus Sym 2 Ai of products. Since it is known that the rational cohomology of both 
these spaces vanishes in positive degree, we have 

Lemma 30. The only non-trivial rational cohomology groups with compact support 
ofA 2 are H?(A 2 ;Q) = Q(-2) and H*{A 2 ;Q) = Q(-l). 

The rational cohomology of A3 was computed by Hain ([Ha]). We state below 
his result in terms of cohomology with compact support. 

Theorem 31 (Hain). The non-trivial Betti numbers with compact support of A3 
are 



i 


12 


10 


8 6 


h 


1 


1 


1 2 



Furthermore, all cohomology groups are algebraic with the exception of (A3; Q), 
which is an extension ofQ(— 3) by Q. 

We deduce the results we need on non-trivial symplectic local systems with 
weight < 2 from results on moduli spaces of curves ([BT],[T3]). Note that the 
result for ¥1,1 was already proven in [HT, Lemma 3.1]. 

Lemma 32. The cohomology groups with compact support of the weight 2 sym- 
plectic local systems on M 2 are as follows: the cohomology of ¥2,0 vanishes in all 
degrees, whereas the only non-zero cohomology group with compact support o/¥i,i 
isH*{M 2 ;V 1 , 1 )=Q. 

Lemma 33. The rational cohomology of M3 with coefficients m ¥1,0,0 and ¥2,0,0 
is in all degrees. The only non-trivial cohomology group with compact support of 
M.3 with coefficients in ¥1,1,0 * s H^(M3] ¥1,1,0) = Q( — 5). 

Proof of Lemma 33. Following the approach of [G2] , we use the forgetful maps 
Pi ■ M-3,1 — > M3 and p 2 : M.3^ — > M.3 to obtain information. Note that p\ is the 
universal curve over M3 and that the fibre of p 2 is the configuration space of 2 
distinct points on a genus 3 curve. 
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According to [BT, Cor. 1], there is an isomorphism H*(M 3 ,i;Q) = H*(M 3 ; <Q>)® 
^•(P 1 ; Q) as vector spaces with mixed Hodge structures. If we compare this with 
the Leray spectral sequence in cohomology associated with pi, we get that the 
cohomology of M3 with coefficients in ¥1,0,0 must vanish. 

Next, we analyze the Leray spectral sequence in cohomology associated with p 2 . 
Taking the 62-action into account, the cohomology of the fibre of p 2 induces the 
following local systems on Ads- 





local system: 


local system: 


deg. 


invariant part 


alternating part 





Q 





1 


Vi.0,0 


¥1,0,0 


2 


Q(-i)ev Mi0 


Q(-i)ev 2 ,o,o 


3 





Vi,o, (-l) 



This implies that the cohomology of M.3 with coefficients in ¥2,0,0 (respectively, 
in ¥1,1,0) is strictly related to the @2-alternating (resp. 62-invariant) part of the 
cohomology of M.3.2- The rational cohomology of M3,2 is described with its mixed 
Hodge structures and the action of the symmetric group in [T3, Thm 1.1]. By 
comparing this with the i?2-term of the Leray spectral sequence associated with P2, 
one obtains that the cohomology of ¥2,0,0 vanishes and that the only non-trivial 
cohomology group of ¥1,1,0 is H 3 {M.$; ¥1,1,0) = Q( — 3). Then the claim follows 
from Poincare duality. □ 

Proof of Lemma 32. The proof is analogous to that of Lemma 33. In this case, one 
needs to compare the Leray spectral sequence associated with p 2 : A-^2,2 — ^ 
with the cohomology of M.2,2 computed in [T2, 11,2.2]. Note that in this case the 
cohomology of ¥1,0 vanishes because it is killed by the hyperelliptic involution on 
the universal curve over M.2- □ 

Next, we compute the cohomology of the weight 2 local systems on A2 and 
A3 we are interested in, by using Gysin long exact sequences in cohomology with 
compact support and the stratification A2 = t 2 (A4 2 ) USym 2 A\ of A2, respectively, 
the stratification A3 = t 3 (A4 3 ) U t 2 (A4 2 ) x A\ U Sym 3 A\ of ^3. The result on the 
cohomology with compact support of ¥1,1 was already proved in [HT, Lemma 3.1]. 

Lemma 34. The only non-trivial cohomology groups of A2 with coefficients in a 
local system of weight 2 are ^(^ 2 ;¥i,i) = Q and H^(A 2 ;Y 2 ,o) = Q(-l). 

Proof. Using branching formulae as in [BvdG, §§7-8] , one proves that the restriction 
of ¥2,0 to Sym 2 A\ C A2 coincides with the symmetrization of V2 x Vo on Ai xA\. 
Its cohomology with compact support is then Q(— 1) in degree 3 and trivial in all 
other degrees by e.g. [Gl, Thm. 5.3]. Analogously, one shows that the cohomology 
of Sym 2 A\ with coefficients in the restriction of the local system ¥1,1 is trivial. 
Then the claim follows from the Gysin long exact sequence associated with the 
inclusion Sym 2 A\ C A2 ■ □ 

Lemma 35. The cohomology with compact support of A3 in the local system ¥1,1,0 
is non-trivial only in degree 5 and possibly in degrees 8 and 9 and is given in 
these degrees by H^A 3 ;Y 1A .o) = Q(-l) and Hl(A 3 ; ¥1,1,0) = H^{A 3 : V 1,1,0) = 
Q(-4)® e withee {0,1}. 

Proof. Branching formulae yield that the cohomology with compact support of the 
restriction of ¥1,1,0 to t 2 (A4 2 ) x Ai is equal to Q(— 5) (coming from the local system 
¥1,1 ®¥o on M.2 x Ai) in degree 8, to Q(— 1) in degree 5 (coming from the local 
system Vq <S> ¥q(— 1)) and is trivial in all other degrees. Moreover, the restriction 
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of Vi.1,0 to Sym 3 A\ is trivial, as is easy to prove if one looks at the cohomology of 
the restriction of the universal abelian variety over A3 to Sym 3 Ai . 

It remains to consider the Gysin long exact sequence associated with the closed 
inclusion A r 3 cd C ^3. The only differential which can possibly be non-trivial is 

Q(-5) = H s c (A" 3 cd ; V Mi0 ) — ► H 9 C (M 3 ; Vi,i, ) = Q(-5). 

From this the claim follows. □ 
In the investigation of the cohomology with compact support of the locus 0\ 
of semi-abelic varieties of torus rank 2 we also need to consider the cohomology 
with compact support of the weight 4 local system V2.2 on Ai- In the forthcoming 
preprint [T4], we will show that the cohomology of V2.2 vanishes in all degrees. For 
our application, however, we do not need such a complete result. The following 
lemma suffices: 

Lemma 36. The cohomology with compact support of A2 with coefficients in the 
local system ¥2,2 is in all degrees different from 3,4. Furthermore, for every 
weight k there is an isomorphism 

Grjf (ff 3 (.4 2 ;V 2 , 2 )) £* Grf (H±{A 2] V 2>2 )) 

between the graded pieces of the weight filtration. 

Proof. First, we prove that the result holds in the Grothendieck group of ra- 
tional Hodge structures. This requires to prove that the Euler characteristic of 
H'(A2\ ¥2,2) in the Grothendieck group of rational Hodge structures vanishes. By 
branching formulae, the cohomology with compact support of the restriction of V 2j2 
to Sym 2 A\ is equal to the cohomology of the local system Vo <8> Vo(— 2), which is 
equal to Q(— 4) in degree 4 and trivial otherwise. On the other hand, the Euler 
characteristic of H^M.2^2,2) was proved in [Ber, Theorem 11.6] to be equal to 
— [<Q>(— 4)]. Then the additivity of Euler characteristics ensures that the Euler char- 
acteristic of V 2j2 on M2 vanishes. This means that the Euler characteristic of each 
graded piece of the weight filtration on H*(A2', V 2j2 ) is 0. 

More generally, the fact that M.2 and Sym 2 A\ are affine of dimension 3 and 2 re- 
spectively, combined with the Gysin long exact sequence associated to Sym 2 A\ ^ 
A2 implies that the cohomology of A2 with values in any local system is trivial in 
degree greater than 3. Thus, by Poincare duality, the cohomology with compact 
support of A2 can be non-trivial only in degree larger than or equal to 3. Fur- 
thermore, for non-trivial irreducible local systems H° (and hence H%) vanishes, 
whereas H 1 (and hence H%) is always zero by the Raghunathan rigidity theorem 
[R]. This means that the cohomology with compact support of V 2 , 2 on A2 can be 
non-zero only in degrees 3 and 4. The cohomology groups in these degrees are then 
isomorphic when passing to the associated graded pieces of the weight filtration 
as a consequence of the vanishing of the Euler characteristic in the Grothendieck 
group of Hodge structures. □ 
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